00000001:02000400:2.0F:1788845746.985225:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788845762.605991:0:3185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788845764.693510:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 687 MB/s 00000001:01000000:3.0:1788845764.943611:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1575 MB/s 00000001:01000000:2.0:1788845765.193218:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5155 MB/s 00000020:02000000:0.0F:1788845765.766336:0:3276:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_105_g5f3dd0c 00000400:02000000:0.0:1788845767.298305:0:3291:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.148@tcp [8/256/0/180] 00008000:02000000:3.0:1788845770.770019:0:3440:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788845812.410990:0:5248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788845821.543582:0:5826:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788845821.543587:0:5826:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788845821.543710:0:5826:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005e60221a 00000080:02000400:2.0:1788845821.543720:0:5826:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788845821.549344:0:5826:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788845821.549356:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788845821.549449:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000acb73794) 00000020:00000080:2.0:1788845821.549586:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788845821.568338:0:5826:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788845821.568934:0:5826:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788845821.610214:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788845821.610276:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788845821.610299:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788845821.610352:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788845821.610380:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788845821.612135:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788845821.612143:0:5826:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788845821.612171:0:5826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773ebe1 00000020:01000004:2.0:1788845821.612179:0:5826:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788845821.612183:0:5826:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788845821.612187:0:5826:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005e60221a from MGS 00000020:01000004:2.0:1788845821.612191:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788845821.612200:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000026ad9668) 00000020:00000080:2.0:1788845821.612208:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788845821.612448:0:5826:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e60221a from MGS, refs=2 00080000:01000000:2.0:1788845821.612464:0:5826:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788845821.612470:0:5826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773ebef 00000100:00100000:2.0:1788845821.612571:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788845821.612702:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788845821.612713:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788845821.613775:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788845821.613784:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788845821.614639:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788845821.614803:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788845821.614807:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788845821.616048:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788845821.616064:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788845821.616685:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788845821.616691:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788845821.617503:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845821.617913:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845821.617915:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845821.617917:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845821.618148:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845821.618184:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845821.618773:0:5826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0F:1788845821.625085:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788845821.868376:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3735 MB/s 00000001:01000000:3.0:1788845822.118248:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5715 MB/s 00000001:01000000:3.0:1788845822.368782:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1235 MB/s 00000001:01000000:0.0:1788845822.618218:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 851 MB/s 00080000:10000000:0.0:1788845822.630966:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1788845822.633087:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788845822.653611:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788845822.653627:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788845822.653629:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788845822.658294:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788845822.658402:0:5826:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788845822.658451:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788845822.658727:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788845822.658753:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788845822.659241:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788845822.659396:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788845822.659401:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788845822.664774:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788845822.664787:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788845822.665461:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788845822.665469:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788845822.666240:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788845822.666260:0:5826:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.148@tcp' 00000020:01000004:0.0:1788845822.666262:0:5826:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788845822.666302:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.148@tcp (typ=mgc) 00000020:00000080:0.0:1788845822.666324:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.148@tcp (00000000ce95b14e) 00000020:00000080:0.0:1788845822.666339:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788845822.666451:0:5826:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e8378eee@MGC192.168.206.148@tcp: add connection 192.168.206.148@tcp at head 00010000:00010000:0.0:1788845822.666585:0:5826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.148@tcp-0 is initialized 00000040:01000000:0.0:1788845822.666591:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788845822.667078:0:5841:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788845822.667445:0:5842:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788845822.667989:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.148@tcp (uuid 355d8611-f7e8-4bd6-8079-f3ef5a03a561) 00000020:00000080:2.0:1788845822.668008:0:5826:0:(genops.c:1385:class_connect()) connect: client 355d8611-f7e8-4bd6-8079-f3ef5a03a561, cookie 0x1345bc80c773ebfd 00000100:00080000:2.0:1788845822.668018:0:5826:0:(import.c:510:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788845822.668022:0:5826:0:(import.c:624:import_select_connection()) MGC192.168.206.148@tcp: import 00000000e8378eee using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1788845822.668061:0:5826:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006235d8a9 x1875740738977920/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788845822.668176:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006235d8a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3306:1875740738977920:0@lo:250: 00000100:00100000:2.0:1788845822.668243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788845822.668298:0:5826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 355d8611-f7e8-4bd6-8079-f3ef5a03a561->MGS 00000020:01000004:2.0:1788845822.668313:0:5826:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788845822.668318:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788845822.668327:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007ebbc293) 00000020:00000080:2.0:1788845822.668337:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788845822.670920:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738977920 00000100:00100000:1.0:1788845822.670933:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738977920 00000100:00100000:1.0:1788845822.670984:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845822.670991:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004486b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3306:x1875740738977920:12345-0@lo:250: 00010000:00080000:1.0:1788845822.671017:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 355d8611-f7e8-4bd6-8079-f3ef5a03a561@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:1.0:1788845822.671059:0:5839:0:(genops.c:1385:class_connect()) connect: client 355d8611-f7e8-4bd6-8079-f3ef5a03a561, cookie 0x1345bc80c773ec0b 00000100:00080000:1.0:1788845822.671223:0:5839:0:(import.c:65:import_set_state_nolock()) 0000000061d3999e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845822.671327:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004486b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:3306:x1875740738977920:12345-0@lo:250: Request processed in 335us (3084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845822.671335:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845822.673748:0:3306:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788845822.673764:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.148@tcp: connect to target with instance 0 00000100:00080000:0.0:1788845822.673771:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788845822.673776:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788845822.673779:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000e8378eee MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788845822.673783:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788845822.673789:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788845822.673796:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006235d8a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3306:1875740738977920:0@lo:250: 00000100:00100000:2.0:1788845822.684403:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845822.684768:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788845822.684775:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788845822.686000:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788845822.686010:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788845822.687511:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788845822.687524:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788845822.688255:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845822.688438:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788845822.688443:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788845822.690398:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788845822.690408:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788845822.718110:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788845822.718377:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788845822.718383:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788845822.719441:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788845822.719449:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788845822.719988:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788845822.720276:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788845822.720282:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788845822.720713:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788845822.720720:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788845822.722139:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845822.722363:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788845822.722368:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788845822.723869:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788845822.723879:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788845822.724529:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788845822.724870:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788845822.724876:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788845822.725603:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788845822.725610:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788845822.761778:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845822.761985:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788845822.761991:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788845822.764439:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788845822.764452:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788845822.765969:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788845822.765978:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788845822.766600:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788845822.766620:0:5826:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788845822.766625:0:5826:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788845822.766812:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788845822.766851:0:5826:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788845822.766855:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788845822.766857:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788845822.766858:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845822.766860:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788845822.766861:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845822.766862:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845822.766863:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788845822.766864:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788845822.766865:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788845822.766867:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788845822.766868:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845822.766869:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788845822.766872:0:5826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788845822.766874:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788845822.766875:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788845822.766876:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845822.766877:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788845822.766878:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845822.766879:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845822.766880:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788845822.766881:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788845822.766882:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788845822.766883:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788845822.766884:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845822.766885:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788845822.766915:0:5826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788845822.766933:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2b5da89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978048:0@lo:253: 00000100:00100000:2.0:1788845822.766992:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845822.767045:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1dbe648 going to sleep for 11 seconds 00000100:00100000:0.0:1788845822.767237:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738978048 00000100:00100000:0.0:1788845822.767244:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738978048 00000100:00100000:0.0:1788845822.767286:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845822.767294:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3ef45e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:5826:x1875740738978048:12345-0@lo:253: 20000000:01000000:0.0:1788845822.767332:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788845822.767335:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788845822.767644:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788845822.767852:0:5840:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788845822.768568:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845822.769590:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788845822.769864:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788845822.769869:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788845822.769874:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788845822.769877:0:5840:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788845822.769891:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788845822.770468:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845822.770668:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788845822.770682:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788845822.770801:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788845822.770864:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788845822.770906:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788845822.771008:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788845822.771017:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788845822.771063:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788845822.771146:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788845822.773860:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788845822.773875:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788845822.773908:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788845822.773966:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788845822.774016:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788845822.774021:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788845822.774032:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845822.774383:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788845822.774394:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788845822.774429:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788845822.774457:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788845822.774494:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788845822.774503:0:5840:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788845822.774574:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788845822.774581:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788845822.774629:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788845822.774665:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788845822.774772:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788845822.774786:0:5840:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788845822.774879:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788845822.774887:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788845822.774918:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788845822.774950:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788845822.775198:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788845822.775243:0:5840:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788845822.775251:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788845822.775773:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788845822.776037:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788845822.776057:0:5840:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.148@tcp for mdt 20000000:01000000:3.0:1788845822.776058:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:3.0:1788845822.776228:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788845822.776236:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788845822.776430:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788845822.776440:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:3.0:1788845822.776488:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788845822.776499:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788845822.776531:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788845822.776567:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788845822.776626:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788845822.776629:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788845822.776634:0:5840:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788845822.776640:0:5840:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788845822.780148:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1788845822.780421:0:5840:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788845822.791699:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788845822.791830:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788845822.791993:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788845822.792012:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788845822.792015:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788845822.792018:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788845822.792049:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788845822.792052:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788845822.792084:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788845822.792086:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788845822.795554:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1788845822.795940:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1788845822.795988:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1788845822.796060:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1788845822.796075:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788845822.796077:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788845822.797924:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788845822.798263:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788845822.798327:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788845822.798362:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788845822.798376:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788845822.798379:0:5840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1788845822.798386:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788845822.798406:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003d46302b/0x1345bc80c773ec12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845822.798422:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d46302b/0x1345bc80c773ec12 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845822.798432:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003d46302b/0x1345bc80c773ec12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845822.798438:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003d46302b/0x1345bc80c773ec12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845822.798443:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003d46302b/0x1345bc80c773ec12 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845822.798449:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003d46302b/0x1345bc80c773ec12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845822.798455:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003d46302b already unused, calling callback (0000000046363818) 00010000:00010000:0.0:1788845822.798458:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003d46302b/0x1345bc80c773ec12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845822.798464:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003d46302b/0x1345bc80c773ec12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845822.798476:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003d46302b/0x1345bc80c773ec12 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845822.798495:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003d46302b/0x1345bc80c773ec12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845822.798500:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003d46302b/0x1345bc80c773ec12 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788845822.798516:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788845822.998477:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3ef45e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:5826:x1875740738978048:12345-0@lo:253: Request processed in 231131us (231432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845822.998503:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788845822.998519:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2b5da89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978048:0@lo:253: 10000000:01000000:2.0:1788845822.998536:0:5826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788845822.998540:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788845822.998542:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788845822.998543:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845822.998545:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788845822.998546:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845822.998548:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845822.998549:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788845822.998550:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788845822.998551:0:5826:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788845822.998553:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845822.998554:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788845822.998572:0:5826:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005e60221a from lustre-MDT0000 10000000:01000000:2.0:1788845822.998597:0:5826:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788845822.998600:0:5826:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788845822.998603:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a0c088c4d28 10000000:01000000:2.0:1788845822.998607:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788845822.998614:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a0c088c4d28 from 1 10000000:01000000:2.0:1788845822.998617:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788845822.998650:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845822.998660:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845822.998669:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845822.998702:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2b5da89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978176:0@lo:101: 00000100:00100000:2.0:1788845822.998737:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845822.998790:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5ce3a14 going to sleep for 11 seconds 00000100:00100000:1.0:1788845822.998990:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738978176 00000100:00100000:1.0:1788845822.999004:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738978176 00000100:00100000:1.0:1788845822.999046:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845822.999054:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c614c37d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:5826:x1875740738978176:12345-0@lo:101: 00010000:00010000:1.0:1788845822.999065:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845822.999076:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000095f7a341/0x1345bc80c773ec20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ec19 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845822.999096:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000095f7a341/0x1345bc80c773ec20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ec19 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845822.999105:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000095f7a341/0x1345bc80c773ec20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ec19 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845822.999112:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000095f7a341, rc 0) 00000100:00100000:1.0:1788845822.999173:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c614c37d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+6:5826:x1875740738978176:12345-0@lo:101: Request processed in 100us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845822.999180:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845822.999257:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2b5da89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978176:0@lo:101: 00010000:00010000:3.0:1788845822.999269:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec20 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845822.999276:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ec20 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845822.999342:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001283a4b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978304:0@lo:501: 00000100:00100000:3.0:1788845822.999367:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845822.999399:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f02d01bd going to sleep for 11 seconds 00000100:00100000:1.0:1788845822.999636:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738978304 00000100:00100000:1.0:1788845822.999641:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738978304 00000100:00100000:1.0:1788845822.999671:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845822.999676:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b4df4aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+6:5826:x1875740738978304:12345-0@lo:501: 00000100:00100000:1.0:1788845822.999905:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b4df4aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+6:5826:x1875740738978304:12345-0@lo:501: Request processed in 228us (537us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788845822.999912:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845823.000116:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001283a4b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978304:0@lo:501: 10000000:01000000:3.0:1788845823.000138:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788845823.000178:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec20 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.000186:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec20 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845823.000193:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a0c0942a000 10000000:01000000:3.0:1788845823.000197:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788845823.000200:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a0c0942a000 10000000:01000000:3.0:1788845823.000203:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788845823.000205:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a0c0942a000 from 1 10000000:01000000:3.0:1788845823.000207:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788845823.000225:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000623cb80f/0x1345bc80c773ec27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.000231:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000623cb80f/0x1345bc80c773ec27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.000238:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000623cb80f/0x1345bc80c773ec27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845823.000249:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001283a4b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978432:0@lo:101: 00000100:00100000:3.0:1788845823.000274:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845823.000361:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738978432 00000100:00100000:0.0:1788845823.000366:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738978432 00000100:00100000:0.0:1788845823.000390:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788845823.000397:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000386ffd9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+6:5826:x1875740738978432:12345-0@lo:101: 00010000:00010000:0.0:1788845823.000404:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845823.000413:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003d46302b/0x1345bc80c773ec2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ec27 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845823.000541:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d46302b/0x1345bc80c773ec2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ec27 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845823.000549:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003d46302b/0x1345bc80c773ec2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ec27 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845823.000556:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003d46302b, rc 0) 00000100:00100000:0.0:1788845823.000602:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000386ffd9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+7:5826:x1875740738978432:12345-0@lo:101: Request processed in 206us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845823.000608:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845823.000814:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f02d01bd going to sleep for 11 seconds 00000100:00100000:3.0:1788845823.000830:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001283a4b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978432:0@lo:101: 00010000:00010000:3.0:1788845823.000849:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000623cb80f/0x1345bc80c773ec27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.000857:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000623cb80f/0x1345bc80c773ec27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845823.000880:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788845823.000882:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000623cb80f/0x1345bc80c773ec27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.000888:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000623cb80f/0x1345bc80c773ec27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845823.000893:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788845823.000896:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788845823.000900:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a0c0942a000 10000000:01000000:3.0:1788845823.000903:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788845823.000905:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788845823.000907:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788845823.000919:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.000926:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.000931:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845823.000942:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001283a4b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978560:0@lo:101: 00000100:00100000:3.0:1788845823.000967:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845823.000990:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f02d01bd going to sleep for 11 seconds 00000100:00100000:3.0:1788845823.001010:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738978560 00000100:00100000:3.0:1788845823.001014:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738978560 00000100:00100000:3.0:1788845823.001042:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845823.001048:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af482e4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+7:5826:x1875740738978560:12345-0@lo:101: 00010000:00010000:3.0:1788845823.001059:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845823.001067:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f9b21b5d/0x1345bc80c773ec3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ec35 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.001080:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9b21b5d/0x1345bc80c773ec3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ec35 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.001093:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f9b21b5d/0x1345bc80c773ec3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ec35 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.001098:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f9b21b5d, rc 0) 00000100:00100000:3.0:1788845823.001125:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af482e4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+8:5826:x1875740738978560:12345-0@lo:101: Request processed in 77us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845823.001131:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788845823.001138:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001283a4b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978560:0@lo:101: 00010000:00010000:2.0:1788845823.001147:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.001177:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ec3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845823.001289:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978688:0@lo:501: 00000100:00100000:3.0:1788845823.001396:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845823.001511:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b731ef5 going to sleep for 11 seconds 00000100:00100000:0.0:1788845823.001549:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738978688 00000100:00100000:0.0:1788845823.001553:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738978688 00000100:00100000:0.0:1788845823.001584:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845823.001594:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000791be455 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+8:5826:x1875740738978688:12345-0@lo:501: 00000100:00100000:0.0:1788845823.001823:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000791be455 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:5826:x1875740738978688:12345-0@lo:501: Request processed in 228us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845823.001830:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788845823.002011:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978688:0@lo:501: 00000100:00100000:3.0:1788845823.002036:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978816:0@lo:503: 00000100:00100000:3.0:1788845823.002068:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845823.002084:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b731ef5 going to sleep for 11 seconds 00000100:00100000:0.0:1788845823.002094:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738978816 00000100:00100000:0.0:1788845823.002098:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738978816 00000100:00100000:0.0:1788845823.002181:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788845823.002187:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0525384 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:5826:x1875740738978816:12345-0@lo:503: 00000100:00100000:0.0:1788845823.002488:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0525384 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:5826:x1875740738978816:12345-0@lo:503: Request processed in 301us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845823.002495:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788845823.002573:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738978816:0@lo:503: 00000100:00100000:0.0:1788845823.003053:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5868:1875740738978944:0@lo:502: 00000100:00100000:0.0:1788845823.003088:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845823.003117:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e328e3b going to sleep for 11 seconds 00000100:00100000:2.0:1788845823.003173:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738978944 00000100:00100000:2.0:1788845823.003178:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738978944 00000100:00100000:2.0:1788845823.003244:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788845823.003251:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000677581c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:5868:x1875740738978944:12345-0@lo:502: 00000100:00100000:2.0:1788845823.003424:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000677581c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:5868:x1875740738978944:12345-0@lo:502: Request processed in 174us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845823.003432:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845823.003510:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5868:1875740738978944:0@lo:502: 00000020:01000000:0.0:1788845823.003532:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845823.003541:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845823.003543:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788845823.003548:0:5868:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788845823.003551:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788845823.003563:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000fa623c66) 00000020:00000080:0.0:1788845823.003579:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788845823.003583:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788845823.003644:0:5868:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788845823.003651:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773ec4a 00000020:00000080:0.0:1788845823.003932:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788845823.003937:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845823.003940:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845823.003942:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788845823.003950:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845823.003954:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845823.003956:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788845823.003959:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788845823.003965:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000045a5b0ac) 00000020:00000080:0.0:1788845823.003974:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788845823.003978:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788845823.003980:0:5868:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788845823.003982:0:5868:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788845823.003988:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788845823.004026:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e60221a from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788845823.004037:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000006144379b) 00000020:00000080:0.0:1788845823.004045:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788845823.004107:0:5868:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788845823.004114:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1345bc80c773ec5f 00000020:00000080:0.0:1788845823.004231:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788845823.004237:0:5868:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788845823.004241:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1345bc80c773ec66 00080000:01000000:0.0:1788845823.004246:0:5868:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788845823.004249:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773ec6d 00080000:10000000:0.0:1788845823.004732:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788845823.004983:0:5868:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788845823.008931:0:5868:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788845823.065827:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788845823.066298:0:5868:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788845823.068679:0:5868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788845823.068948:0:5868:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788845823.114317:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000052a7c88e) 00000020:00000080:1.0:1788845823.115861:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788845823.115964:0:5868:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788845823.115971:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773ec7b 00000020:00000080:1.0:1788845823.116476:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788845823.117685:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845823.158300:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845823.202868:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845823.231683:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845823.261958:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788845823.286015:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788845823.316136:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1345bc80c773ec82 00000020:00000080:0.0:1788845823.316511:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788845823.316521:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845823.316530:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845823.316532:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788845823.316534:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845823.316539:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845823.316540:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788845823.316544:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788845823.316572:0:5868:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788845823.316590:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845823.316592:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845823.316594:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788845823.316596:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845823.316598:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845823.316599:0:5868:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788845823.316601:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788845823.316603:0:5868:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788845823.316638:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5868:1875740738979072:0@lo:502: 00000100:00100000:0.0:1788845823.316702:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845823.316785:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a536726 going to sleep for 11 seconds 00000100:00100000:0.0:1788845823.317709:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738979072 00000100:00100000:0.0:1788845823.317717:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738979072 00000100:00100000:0.0:1788845823.317757:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845823.317765:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063f86bf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:5868:x1875740738979072:12345-0@lo:502: 00000100:00100000:1.0:1788845823.320698:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063f86bf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:5868:x1875740738979072:12345-0@lo:502: Request processed in 2928us (3991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845823.320712:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845823.321122:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5868:1875740738979072:0@lo:502: 00000020:01000000:0.0:1788845823.321178:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845823.321185:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845823.321187:0:5868:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788845823.321191:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788845823.329422:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788845823.329473:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788845823.329496:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.329509:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845823.329517:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a0c0942a000 from 1 10000000:01000000:3.0:1788845823.329519:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788845823.329559:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.329567:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.329575:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845823.329600:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979200:0@lo:101: 00000100:00100000:3.0:1788845823.329664:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845823.329717:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 000000006a448c80 going to sleep for 11 seconds 00000100:00100000:0.0:1788845823.330492:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738979200 00000100:00100000:0.0:1788845823.330502:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738979200 00000100:00100000:0.0:1788845823.330558:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845823.330566:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e8edad8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:5826:x1875740738979200:12345-0@lo:101: 00010000:00010000:0.0:1788845823.330582:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845823.330596:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006940cc2b/0x1345bc80c773ec90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ec89 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845823.330616:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006940cc2b/0x1345bc80c773ec90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ec89 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845823.330638:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006940cc2b/0x1345bc80c773ec90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ec89 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845823.330645:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006940cc2b, rc 0) 00000100:00100000:0.0:1788845823.330688:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e8edad8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:5826:x1875740738979200:12345-0@lo:101: Request processed in 123us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845823.330694:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788845823.331249:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979200:0@lo:101: 00010000:00010000:3.0:1788845823.331262:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec90 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.331271:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ec90 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845823.331807:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979328:0@lo:256: 00000100:00100000:3.0:1788845823.331875:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845823.331913:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 000000006a448c80 going to sleep for 11 seconds 00000100:00100000:1.0:1788845823.332192:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738979328 00000100:00100000:1.0:1788845823.332199:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738979328 00000100:00100000:1.0:1788845823.332237:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845823.332245:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ae99e65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:5826:x1875740738979328:12345-0@lo:256: 20000000:01000000:1.0:1788845823.332261:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788845823.332266:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788845823.332327:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ae99e65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:5826:x1875740738979328:12345-0@lo:256: Request processed in 83us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845823.332334:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788845823.333216:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979328:0@lo:256: 10000000:01000000:3.0:1788845823.333928:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788845823.333947:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec90 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.333958:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec90 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845823.337609:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c0942a000 from 1 10000000:01000000:0.0:1788845823.337617:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845823.337659:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845823.337671:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845823.337680:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845823.337701:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979456:0@lo:101: 00000100:00100000:0.0:1788845823.337761:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845823.337815:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a536726 going to sleep for 11 seconds 00000100:00100000:3.0:1788845823.337921:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738979456 00000100:00100000:3.0:1788845823.337929:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738979456 00000100:00100000:3.0:1788845823.337972:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788845823.337980:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001807d2f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:5826:x1875740738979456:12345-0@lo:101: 00010000:00010000:3.0:1788845823.337991:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845823.338003:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000009014118/0x1345bc80c773ec9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ec97 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.338024:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009014118/0x1345bc80c773ec9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ec97 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.338034:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000009014118/0x1345bc80c773ec9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ec97 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.338043:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000009014118, rc 0) 00000100:00100000:3.0:1788845823.338087:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001807d2f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:5826:x1875740738979456:12345-0@lo:101: Request processed in 108us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845823.338094:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845823.338243:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979456:0@lo:101: 00010000:00010000:0.0:1788845823.338255:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec9e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845823.338263:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ec9e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845823.338317:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979584:0@lo:501: 00000100:00100000:0.0:1788845823.338341:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845823.338367:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a536726 going to sleep for 11 seconds 00000100:00100000:3.0:1788845823.338544:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738979584 00000100:00100000:3.0:1788845823.338549:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738979584 00000100:00100000:3.0:1788845823.338573:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788845823.338578:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022b2fc11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:5826:x1875740738979584:12345-0@lo:501: 00000100:00100000:3.0:1788845823.339064:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022b2fc11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:5826:x1875740738979584:12345-0@lo:501: Request processed in 485us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845823.339072:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788845823.339229:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979584:0@lo:501: 00000100:00100000:0.0:1788845823.339259:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979712:0@lo:503: 00000100:00100000:0.0:1788845823.339294:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845823.339314:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a536726 going to sleep for 11 seconds 00000100:00100000:1.0:1788845823.339357:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738979712 00000100:00100000:1.0:1788845823.339362:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738979712 00000100:00100000:1.0:1788845823.339394:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788845823.339401:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe99255a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:5826:x1875740738979712:12345-0@lo:503: 00000040:00080000:1.0:1788845823.339431:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788845823.339485:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe99255a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:5826:x1875740738979712:12345-0@lo:503: Request processed in 84us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845823.339491:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788845823.339747:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979712:0@lo:503: 00000040:00080000:0.0:1788845823.347046:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788845823.347198:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788845823.347220:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845823.347236:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec9e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.347248:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec9e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845823.347287:0:5826:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788845823.347290:0:5826:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a0c0942a000 10000000:01000000:3.0:1788845823.347292:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a0c0942a000 10000000:01000000:3.0:1788845823.347296:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788845823.347301:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a0c0942a000 from 1 10000000:01000000:3.0:1788845823.347304:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788845823.347348:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.347356:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.347365:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845823.347394:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979840:0@lo:101: 00000100:00100000:3.0:1788845823.347470:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845823.347512:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000894d0b3c going to sleep for 11 seconds 00000100:00100000:1.0:1788845823.347664:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738979840 00000100:00100000:1.0:1788845823.347672:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738979840 00000100:00100000:1.0:1788845823.347721:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788845823.347735:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008606ba14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:5826:x1875740738979840:12345-0@lo:101: 00010000:00010000:1.0:1788845823.347748:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845823.347759:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008dc6365a/0x1345bc80c773ecac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773eca5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845823.347783:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008dc6365a/0x1345bc80c773ecac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773eca5 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845823.347792:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008dc6365a/0x1345bc80c773ecac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773eca5 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845823.347800:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008dc6365a, rc 0) 00000100:00100000:1.0:1788845823.347852:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008606ba14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5826:x1875740738979840:12345-0@lo:101: Request processed in 118us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845823.347858:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788845823.347892:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979840:0@lo:101: 00010000:00010000:3.0:1788845823.347904:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ecac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845823.347912:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ecac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845823.347955:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979968:0@lo:501: 00000100:00100000:3.0:1788845823.347978:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845823.348001:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000894d0b3c going to sleep for 11 seconds 00000100:00100000:1.0:1788845823.348045:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738979968 00000100:00100000:1.0:1788845823.348049:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738979968 00000100:00100000:1.0:1788845823.348076:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788845823.348082:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009111f821 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5826:x1875740738979968:12345-0@lo:501: 00000100:00100000:1.0:1788845823.348332:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009111f821 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5826:x1875740738979968:12345-0@lo:501: Request processed in 250us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845823.348338:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788845823.348457:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738979968:0@lo:501: 00000100:00100000:3.0:1788845823.348484:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738980096:0@lo:503: 00000100:00100000:3.0:1788845823.348522:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845823.348543:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000894d0b3c going to sleep for 11 seconds 00000100:00100000:1.0:1788845823.349579:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738980096 00000100:00100000:1.0:1788845823.349589:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738980096 00000100:00100000:1.0:1788845823.349635:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788845823.349642:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000598069e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5826:x1875740738980096:12345-0@lo:503: 00000100:00100000:1.0:1788845823.350077:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000598069e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5826:x1875740738980096:12345-0@lo:503: Request processed in 434us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845823.350096:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788845823.350120:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738980096:0@lo:503: 00000100:00100000:0.0:1788845823.359481:0:5873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5873:1875740738980224:0@lo:502: 00000100:00100000:0.0:1788845823.359567:0:5873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845823.359619:0:5873:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c8bf7390 going to sleep for 11 seconds 00000100:00100000:2.0:1788845823.359737:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738980224 00000100:00100000:2.0:1788845823.359745:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738980224 00000100:00100000:2.0:1788845823.359791:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788845823.359800:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002586b34d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5873:x1875740738980224:12345-0@lo:502: 00000100:00100000:2.0:1788845823.360084:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002586b34d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5873:x1875740738980224:12345-0@lo:502: Request processed in 284us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845823.360093:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788845823.360207:0:5873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5873:1875740738980224:0@lo:502: 00000020:01000004:0.0:1788845823.360261:0:5873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788845823.360284:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007dc38f53) 00000020:00000080:0.0:1788845823.360302:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788845823.360369:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e60221a from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788845823.360372:0:5873:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005e60221a from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788845823.360375:0:5873:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005e60221a 4 00010000:00080000:0.0:1788845823.360401:0:5873:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f7ccbcc5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:0.0:1788845823.362729:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788845823.362970:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788845823.363003:0:5873:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788845823.363013:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1345bc80c773ecba 00000100:00080000:0.0:1788845823.363023:0:5873:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788845823.363032:0:5873:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f7ccbcc5 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1788845823.363062:0:5873:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dbb5ee48 x1875740738980352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788845823.363117:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875740738980352:0@lo:38: 00000100:00100000:2.0:1788845823.363209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788845823.363290:0:5873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788845823.367178:0:5873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000933bac8f pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5873:1875740738980480:0@lo:502: 00000100:00100000:0.0:1788845823.367256:0:5873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845823.367298:0:5873:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f9b7ac5f going to sleep for 11 seconds 00000100:00100000:1.0:1788845823.369077:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738980480 00000100:00100000:1.0:1788845823.369090:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738980480 00000100:00100000:1.0:1788845823.369142:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788845823.369149:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000003a7c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5873:x1875740738980480:12345-0@lo:502: 00000100:00100000:1.0:1788845823.369391:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000003a7c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5873:x1875740738980480:12345-0@lo:502: Request processed in 242us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845823.369399:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788845823.369452:0:5873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000933bac8f pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5873:1875740738980480:0@lo:502: 00000040:00080000:1.0:1788845823.370122:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1788845823.370426:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738980352 00000100:00100000:2.0:1788845823.370432:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738980352 00000100:00100000:2.0:1788845823.370460:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845823.370466:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4061ff8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875740738980352:12345-0@lo:38: 00000100:00100000:2.0:1788845823.370534:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4061ff8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875740738980352:12345-0@lo:38: Request processed in 68us (7326us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788845823.370541:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845823.370584:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788845823.370591:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000f7ccbcc5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788845823.370595:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788845823.370598:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dbb5ee48 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875740738980352:0@lo:38: 00000020:01000000:0.0:1788845823.370683:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788845823.370702:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845823.370720:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ecac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845823.370730:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ecac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788845823.370777:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788845823.370779:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788845823.370781:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845823.370782:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845823.370783:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845823.370784:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845823.370785:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788845823.370787:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788845823.370788:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845823.370789:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845823.370791:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845823.370792:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788845823.370795:0:5826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788845823.370797:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788845823.370799:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788845823.370800:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845823.370801:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845823.370802:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845823.370807:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845823.370808:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788845823.370809:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788845823.370809:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845823.370810:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845823.370811:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845823.370812:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788845823.370830:0:5826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788845823.370852:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e4b4615 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738980608:0@lo:253: 00000100:00100000:0.0:1788845823.370892:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845823.370915:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f9b7ac5f going to sleep for 11 seconds 00000100:00100000:2.0:1788845823.370965:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738980608 00000100:00100000:2.0:1788845823.370970:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738980608 00000100:00100000:2.0:1788845823.371183:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788845823.371191:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088f19d08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5826:x1875740738980608:12345-0@lo:253: 20000000:01000000:2.0:1788845823.371214:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788845823.371227:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788845823.415282:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788845823.415302:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788845823.415363:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788845823.415367:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788845823.415393:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845823.415410:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006940cc2b/0x1345bc80c773ec90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ec89 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845823.415418:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845823.415471:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006940cc2b/0x1345bc80c773ec90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ec89 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845823.415485:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006940cc2b/0x1345bc80c773ec90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ec89 expref: 12 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845823.415498:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c103eccc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875740738980736:0@lo:104: 00000100:00100000:1.0:1788845823.415565:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845823.415619:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c7d88f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788845823.415750:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738980736 00000100:00100000:2.0:1788845823.415758:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738980736 00000100:00100000:2.0:1788845823.415815:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845823.415822:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000675d5344 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:5861:x1875740738980736:12345-0@lo:104: 00010000:00010000:2.0:1788845823.415833:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ec90 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.415892:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788845823.415896:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000675d5344 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:5861:x1875740738980736:12345-0@lo:104: Request processed in 76us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845823.415911:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788845823.415930:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845823.415935:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ec90 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.415941:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008fd47d1b already unused, calling callback (000000005573eee6) 10000000:00010000:2.0:1788845823.415944:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ec90 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.415951:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ec90 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845823.415957:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ec90 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845823.415962:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845823.415986:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ec90 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.415991:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845823.416004:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ec90 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416009:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 000000008fd47d1b/0x1345bc80c773ec89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ec90 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416022:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845823.416023:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845823.416024:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845823.416074:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2e53852 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740738980864:0@lo:103: 00000100:00100000:2.0:1788845823.416104:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845823.416191:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738980864 00000100:00100000:2.0:1788845823.416195:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738980864 00010000:00010000:2.0:1788845823.416209:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006940cc2b/0x1345bc80c773ec90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ec89 expref: 13 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845823.416231:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845823.416237:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f89377c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:3308:x1875740738980864:12345-0@lo:103: 00010000:00010000:2.0:1788845823.416246:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845823.416249:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006940cc2b/0x1345bc80c773ec90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ec89 expref: 13 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416258:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006940cc2b/0x1345bc80c773ec90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ec89 expref: 13 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416272:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416278:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788845823.416289:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000922892s 00010000:00010000:2.0:1788845823.416292:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416298:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416304:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416318:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416323:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000680c46cb already unused, calling callback (0000000046363818) 00010000:00010000:2.0:1788845823.416325:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416331:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416338:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416346:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845823.416371:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f89377c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:3308:x1875740738980864:12345-0@lo:103: Request processed in 135us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845823.416389:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845823.416432:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2e53852 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740738980864:0@lo:103: 00010000:00010000:2.0:1788845823.416456:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006940cc2b/0x1345bc80c773ec90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ec89 expref: 12 pid: 5839 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845823.416467:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c103eccc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875740738980736:0@lo:104: 00010000:00010000:2.0:1788845823.416479:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416486:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416491:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845823.416502:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000680c46cb/0x1345bc80c773ecc1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845823.429224:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088f19d08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:5826:x1875740738980608:12345-0@lo:253: Request processed in 58028us (58325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845823.429238:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788845823.429340:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e4b4615 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5826:1875740738980608:0@lo:253: 10000000:01000000:0.0:1788845823.429354:0:5826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788845823.429357:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788845823.429359:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788845823.429360:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845823.429361:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845823.429363:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845823.429364:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845823.429365:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788845823.429367:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788845823.429368:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845823.429369:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845823.429371:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845823.429372:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788845823.429392:0:5826:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788845823.437873:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845823.440644:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788845823.440929:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845823.441074:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788845823.443530:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788845823.445622:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788845823.448857:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788845823.449039:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788845823.449963:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788845823.453689:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788845823.454086:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788845823.454648:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788845823.545886:0:5826:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788845823.585510:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788845823.585975:0:5878:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788845823.585980:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788845823.586247:0:5879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788845823.601316:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788845823.602301:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788845823.602807:0:5826:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788845823.602817:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788845823.602977:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845823.603947:0:5826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788845823.604947:0:5826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788845823.604980:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788845823.605857:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788845823.606046:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788845823.609595:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788845823.609736:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788845823.609890:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788845823.610056:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788845823.610228:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788845823.610365:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788845823.610513:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788845823.610641:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788845823.610773:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788845823.610914:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788845823.611058:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788845823.611220:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788845823.611367:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788845823.611503:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788845823.616526:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788845823.616705:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788845823.617096:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788845823.617276:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788845823.617638:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788845823.617873:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788845823.618031:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788845823.618291:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788845823.618560:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788845823.618711:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788845823.619201:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788845823.619327:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788845823.619546:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788845823.619680:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788845823.620061:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788845823.620241:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788845823.620523:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788845823.620672:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788845823.620992:0:5826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788845823.643491:0:5879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:2.0:1788845823.661817:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788845823.692707:0:5879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788845823.692782:0:5879:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788845823.692786:0:5879:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1788845823.693228:0:5826:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788845823.693246:0:5826:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb360c1e0f988 00100000:10000000:0.0:1788845823.693253:0:5826:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788845823.693644:0:5826:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788845823.693658:0:5826:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788845823.693674:0:5826:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788845823.693688:0:5826:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788845824.679029:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845825.703077:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845826.727938:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788845827.247400:0:6122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788845827.753384:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845828.519890:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006752587 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738980992:0@lo:400: 00000100:00100000:3.0:1788845828.519960:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788845828.520041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788845828.520046:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788845828.520049:0:36:0:(import.c:65:import_set_state_nolock()) 00000000f7ccbcc5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788845828.520058:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f7ccbcc5 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1788845828.520081:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000003f6c6dd x1875740738981120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788845828.520203:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003f6c6dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875740738981120:0@lo:38: 00000100:00100000:1.0:1788845828.520251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.520330:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738981120 00000100:00100000:1.0:1788845828.520336:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738981120 00000100:00100000:1.0:1788845828.520377:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845828.520395:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8257008 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875740738981120:12345-0@lo:38: 00010000:00080000:1.0:1788845828.520419:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:1.0:1788845828.520455:0:5847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1345bc80c773ecc8 00000004:00100000:1.0:1788845828.520493:0:5847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788845828.520608:0:5847:0:(import.c:65:import_set_state_nolock()) 0000000013e82c7c : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845828.520657:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8257008 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875740738981120:12345-0@lo:38: Request processed in 272us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845828.520669:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788845828.520707:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000003f6c6dd x1875740738981120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788845828.520721:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788845828.520728:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788845828.520732:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788845828.520734:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000f7ccbcc5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788845828.520739:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003f6c6dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875740738981120:0@lo:38: 00000100:00100000:2.0:1788845828.520901:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738980992 00000100:00100000:2.0:1788845828.520905:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738980992 00000100:00100000:2.0:1788845828.520942:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788845828.520949:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038eac666 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:3309:x1875740738980992:12345-0@lo:400: 00000100:00100000:2.0:1788845828.528331:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038eac666 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:3309:x1875740738980992:12345-0@lo:400: Request processed in 7374us (8363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845828.528347:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788845828.532128:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006752587 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738980992:0@lo:400: 00010000:00010000:1.0:1788845828.774538:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788845829.542395:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788845829.542402:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a0c0942a000 from 3 10000000:01000000:2.0:1788845829.542407:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788845829.542460:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000d72d9630/0x1345bc80c773eccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845829.542481:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000d72d9630/0x1345bc80c773eccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845829.542491:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000d72d9630/0x1345bc80c773eccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845829.542534:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2e53852 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738981248:0@lo:101: 00000100:00100000:2.0:1788845829.542603:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845829.542659:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054e8f960 going to sleep for 11 seconds 00000100:00100000:3.0:1788845829.542775:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738981248 00000100:00100000:3.0:1788845829.542783:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738981248 00000100:00100000:3.0:1788845829.542844:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788845829.542853:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098838897 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:5842:x1875740738981248:12345-0@lo:101: 00010000:00010000:3.0:1788845829.542865:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845829.542878:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009551e13d/0x1345bc80c773ecd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773eccf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845829.542900:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009551e13d/0x1345bc80c773ecd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773eccf expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845829.542909:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009551e13d/0x1345bc80c773ecd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773eccf expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845829.542917:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009551e13d, rc 0) 00000100:00100000:3.0:1788845829.542960:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098838897 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5842:x1875740738981248:12345-0@lo:101: Request processed in 109us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845829.542967:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788845829.543044:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2e53852 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738981248:0@lo:101: 00010000:00010000:2.0:1788845829.543054:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000d72d9630/0x1345bc80c773eccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ecd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845829.543062:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000d72d9630/0x1345bc80c773eccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ecd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845829.543204:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2e53852 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738981376:0@lo:256: 00000100:00100000:2.0:1788845829.543235:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845829.543251:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054e8f960 going to sleep for 11 seconds 00000100:00100000:3.0:1788845829.543307:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738981376 00000100:00100000:3.0:1788845829.543312:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738981376 00000100:00100000:3.0:1788845829.543333:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788845829.543339:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f4f34df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5842:x1875740738981376:12345-0@lo:256: 20000000:01000000:3.0:1788845829.543352:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788845829.543368:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788845829.543371:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788845829.543446:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f4f34df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5842:x1875740738981376:12345-0@lo:256: Request processed in 107us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845829.543453:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788845829.543532:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2e53852 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738981376:0@lo:256: 10000000:01000000:1.0:1788845829.543592:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788845829.543598:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000d72d9630/0x1345bc80c773eccf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ecd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845829.543605:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000d72d9630/0x1345bc80c773eccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ecd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845829.798491:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845830.824847:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788845831.091138:0:6324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3a3c5eb0 20000000:00000080:3.0:1788845831.091174:0:6324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a0c3cdfc400 uarg=0000000000000000 20000000:01000000:3.0:1788845831.091208:0:6324:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788845831.091214:0:6324:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788845831.091218:0:6324:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788845831.091416:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788845831.091426:0:6324:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788845831.096639:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845831.097497:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788845831.097565:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788845831.097637:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788845831.097658:0:6324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788845831.097675:0:6324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845831.097694:0:6324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000009014118/0x1345bc80c773ec9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ec97 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845831.098627:0:6324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845831.098961:0:6324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000009014118/0x1345bc80c773ec9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ec97 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845831.098978:0:6324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000009014118/0x1345bc80c773ec9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ec97 expref: 11 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845831.098992:0:6324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1875740738981504:0@lo:104: 00000100:00100000:3.0:1788845831.099053:0:6324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845831.099265:0:6324:0:(client.c:2715:ptlrpc_set_wait()) set 00000000077db1eb going to sleep for 11 seconds 00000100:00100000:0.0:1788845831.099398:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738981504 00000100:00100000:0.0:1788845831.099469:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738981504 00000100:00100000:0.0:1788845831.099544:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845831.099556:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066035238 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:6324:x1875740738981504:12345-0@lo:104: 00010000:00010000:0.0:1788845831.099587:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ec9e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845831.099648:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845831.099653:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066035238 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:6324:x1875740738981504:12345-0@lo:104: Request processed in 102us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845831.099663:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788845831.099689:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845831.099694:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ec9e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845831.099702:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000039b597a7 already unused, calling callback (000000005573eee6) 10000000:00010000:0.0:1788845831.099705:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ec9e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845831.099713:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ec9e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845831.099720:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ec9e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845831.099726:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788845831.099759:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ec9e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845831.099767:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845831.099788:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ec9e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845831.099812:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 0000000039b597a7/0x1345bc80c773ec97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ec9e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845831.099841:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845831.099844:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845831.099848:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845831.099857:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845831.099869:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e4b4615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738981632:0@lo:103: 00000100:00100000:0.0:1788845831.099906:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845831.100395:0:6324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1875740738981504:0@lo:104: 00000100:00100000:2.0:1788845831.100588:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738981632 00000100:00100000:2.0:1788845831.100593:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738981632 00010000:00010000:2.0:1788845831.100617:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000009014118/0x1345bc80c773ec9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ec97 expref: 12 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845831.100626:0:6324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845831.100688:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788845831.100704:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009498af61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:3309:x1875740738981632:12345-0@lo:103: 00010000:00010000:2.0:1788845831.100715:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845831.100720:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000009014118/0x1345bc80c773ec9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ec97 expref: 12 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845831.100730:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000009014118/0x1345bc80c773ec9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ec97 expref: 12 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845831.100752:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000009014118/0x1345bc80c773ec9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ec97 expref: 12 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845831.100765:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845831.100772:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845831.100784:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845831.100790:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845831.100807:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845831.100812:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845831.100818:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c1a6562b already unused, calling callback (0000000046363818) 00010000:00010000:2.0:1788845831.100821:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845831.100828:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845831.100848:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845831.100866:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845831.100906:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009498af61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:3309:x1875740738981632:12345-0@lo:103: Request processed in 211us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845831.100913:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788845831.101038:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e4b4615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738981632:0@lo:103: 00010000:00010000:3.0:1788845831.102110:0:6324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845831.102122:0:6324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845831.102128:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c1a6562b/0x1345bc80c773ecdd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845831.847884:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845832.873079:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845833.638372:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003f6c6dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740738981760:0@lo:400: 00000100:00100000:2.0:1788845833.638441:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845833.638498:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845833.638504:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000048f2ce36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740738981888:0@lo:400: 00000100:00100000:2.0:1788845833.638532:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845833.638565:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738981888 00000100:00100000:2.0:1788845833.638573:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738981888 00000100:00100000:2.0:1788845833.638611:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845833.638619:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b9bc70c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740738981888:12345-0@lo:400: 00000100:00100000:2.0:1788845833.638669:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b9bc70c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740738981888:12345-0@lo:400: Request processed in 51us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845833.638676:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788845833.638711:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000048f2ce36 x1875740738981888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845833.638723:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000048f2ce36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740738981888:0@lo:400: 00000100:00100000:3.0:1788845833.639039:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738981760 00000100:00100000:3.0:1788845833.639044:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738981760 00000100:00100000:3.0:1788845833.639114:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788845833.639122:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089553162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:3307:x1875740738981760:12345-0@lo:400: 00000100:00100000:3.0:1788845833.639201:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089553162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:3307:x1875740738981760:12345-0@lo:400: Request processed in 80us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845833.639208:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788845833.639276:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003f6c6dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740738981760:0@lo:400: 00010000:00010000:3.0:1788845833.896732:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845834.918393:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845835.947436:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845836.979226:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788845836.980574:0:6686:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788845836.980576:0:6686:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788845836.980992:0:6686:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007aec08e8 00000020:01000004:0.0:1788845836.981008:0:6686:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788845836.981019:0:6686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788845836.981031:0:6686:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (0000000046ea1718) 00000020:00000080:0.0:1788845836.981061:0:6686:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788845837.013066:0:6686:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788845837.013537:0:6686:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788845837.109777:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788845837.136044:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788845837.136078:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788845837.136147:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788845837.136209:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788845837.137502:0:6686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788845837.137512:0:6686:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788845837.137522:0:6686:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1345bc80c773eceb 00000020:01000004:0.0:1788845837.137529:0:6686:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788845837.137549:0:6686:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788845837.137553:0:6686:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788845837.137559:0:6686:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788845837.137563:0:6686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788845837.137574:0:6686:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000001c4704b3) 00000020:00000080:0.0:1788845837.137728:0:6686:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1788845837.143674:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788845837.143894:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788845837.143900:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788845837.145317:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788845837.145328:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788845837.146026:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788845837.146034:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788845837.148669:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788845837.149039:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788845837.149045:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788845837.187954:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788845837.187974:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788845837.288088:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845837.288935:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788845837.288943:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788845837.298038:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788845837.298057:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788845837.308897:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788845837.308912:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788845837.317424:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788845837.317621:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788845837.317627:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788845837.330672:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788845837.330685:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788845837.522036:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788845837.525316:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788845837.525332:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788845837.542140:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788845837.542178:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788845837.542947:0:6686:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788845837.542978:0:6686:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788845837.542984:0:6686:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788845837.589486:0:6686:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788845837.589524:0:6686:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788845837.589529:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788845837.589530:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788845837.589531:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845837.589532:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845837.589533:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845837.589534:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845837.589535:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845837.589537:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845837.589538:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845837.589539:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845837.589541:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788845837.589544:0:6686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788845837.589547:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788845837.589548:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788845837.589549:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845837.589550:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845837.589551:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845837.589552:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845837.589553:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845837.589554:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845837.589555:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845837.589555:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845837.589556:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788845837.589582:0:6686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788845837.589598:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041368e5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738982016:0@lo:253: 00000100:00100000:0.0:1788845837.589672:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845837.589734:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 00000000239933fb going to sleep for 11 seconds 00000100:00100000:2.0:1788845837.590070:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738982016 00000100:00100000:2.0:1788845837.590084:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738982016 00000100:00100000:2.0:1788845837.590136:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788845837.590144:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007891e086 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:6686:x1875740738982016:12345-0@lo:253: 20000000:01000000:2.0:1788845837.590214:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788845837.590219:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788845837.590223:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788845837.590225:0:5840:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788845837.591447:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788845837.592964:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788845837.592986:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788845837.593043:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788845837.593051:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788845837.593085:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788845837.593143:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788845837.595135:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788845837.595179:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:2.0:1788845837.595181:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:2.0:1788845837.595621:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788845837.595631:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788845837.595691:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788845837.595700:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:2.0:1788845837.595750:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788845837.595770:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788845837.595803:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788845837.597133:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788845837.601742:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788845837.601786:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:2.0:1788845837.601788:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:2.0:1788845837.601961:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788845837.601972:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788845837.602006:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788845837.602022:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:2.0:1788845837.602071:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788845837.602082:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788845837.602113:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788845837.602151:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788845837.602214:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788845837.602217:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788845837.602221:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788845837.602481:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788845837.602485:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788845837.612618:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788845837.612626:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788845837.619644:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788845837.620091:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788845837.620150:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788845837.620604:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788845837.620623:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788845837.620626:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788845837.624052:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788845837.624139:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788845837.624223:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788845837.624508:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788845837.624627:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788845837.624709:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788845837.624724:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788845837.624726:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788845837.627520:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788845837.627935:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788845837.627988:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788845837.631362:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788845837.631448:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788845837.631491:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788845837.631512:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788845837.631514:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788845837.631522:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788845837.634150:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.634182:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000095f7a341/0x1345bc80c773ec20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ec19 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.634189:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f9b21b5d/0x1345bc80c773ec3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ec35 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.634196:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008dc6365a/0x1345bc80c773ecac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773eca5 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.634201:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.634259:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008dc6365a/0x1345bc80c773ecac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773eca5 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.634274:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008dc6365a/0x1345bc80c773ecac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773eca5 expref: 11 pid: 5840 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.634287:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1cd7030 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738982144:0@lo:104: 00000100:00100000:1.0:1788845837.634361:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845837.634433:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f9b21b5d/0x1345bc80c773ec3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ec35 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.634440:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f9b21b5d/0x1345bc80c773ec3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ec35 expref: 11 pid: 5838 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.634448:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041e3f565 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738982272:0@lo:104: 00000100:00100000:1.0:1788845837.634469:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845837.634502:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000095f7a341/0x1345bc80c773ec20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ec19 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.634509:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000095f7a341/0x1345bc80c773ec20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ec19 expref: 11 pid: 5838 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.634517:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002f29996b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738982400:0@lo:104: 00000100:00100000:1.0:1788845837.634549:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845837.634560:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d19e2799 going to sleep for 11 seconds 00000100:00100000:3.0:1788845837.636371:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738982144 00000100:00100000:3.0:1788845837.636383:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738982144 00000100:00100000:3.0:1788845837.636421:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738982272 00000100:00100000:3.0:1788845837.636425:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738982272 00000100:00100000:3.0:1788845837.636435:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738982400 00000100:00100000:3.0:1788845837.636437:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738982400 00000100:00100000:3.0:1788845837.636456:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845837.636464:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002780e537 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:5840:x1875740738982144:12345-0@lo:104: 00010000:00010000:3.0:1788845837.636478:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ecac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.636562:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788845837.636567:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002780e537 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:5840:x1875740738982144:12345-0@lo:104: Request processed in 104us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.636574:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845837.636597:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845837.636603:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e3e7cc5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+4:5840:x1875740738982272:12345-0@lo:104: 00010000:00010000:3.0:1788845837.636610:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ec3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.636677:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788845837.636681:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e3e7cc5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+4:5840:x1875740738982272:12345-0@lo:104: Request processed in 80us (2212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.636688:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845837.636704:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845837.636710:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a84cf315 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:5840:x1875740738982400:12345-0@lo:104: 00010000:00010000:3.0:1788845837.636717:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ec20 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.636754:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788845837.636768:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a84cf315 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:5840:x1875740738982400:12345-0@lo:104: Request processed in 50us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.636774:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788845837.637375:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788845837.637380:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ecac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.637388:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000279ded8a already unused, calling callback (000000005573eee6) 10000000:00010000:3.0:1788845837.637391:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ecac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.637399:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ecac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845837.637405:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ecac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845837.637411:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845837.637459:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ecac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.637466:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845837.637484:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ecac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.637490:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 00000000279ded8a/0x1345bc80c773eca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ecac expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.637503:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788845837.637505:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ec3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.637555:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845837.637717:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845837.637722:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ec20 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.637735:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c4a5ff33 already unused, calling callback (000000005573eee6) 10000000:00010000:2.0:1788845837.637737:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ec20 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.637743:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ec20 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845837.637748:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ec20 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845837.637752:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845837.637775:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ec20 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.637781:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845837.637786:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ec20 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.637810:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ec19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ec20 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.637821:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845837.637823:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845837.637824:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845837.637829:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845837.637830:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845837.637857:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738982528:0@lo:103: 00000100:00100000:2.0:1788845837.637904:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845837.637923:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738982528 00000100:00100000:0.0:1788845837.637934:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738982528 00000100:00100000:2.0:1788845837.637937:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845837.637942:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0b43e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738982656:0@lo:103: 00010000:00010000:0.0:1788845837.637953:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008dc6365a/0x1345bc80c773ecac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773eca5 expref: 12 pid: 5840 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845837.637961:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845837.638073:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001f865d0e already unused, calling callback (000000005573eee6) 10000000:00010000:3.0:1788845837.638076:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ec3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.638081:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ec3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845837.638086:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ec3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845837.638091:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845837.638105:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ec3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.638110:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845837.638124:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ec3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.638138:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 000000001f865d0e/0x1345bc80c773ec35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ec3c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.638150:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845837.638177:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845837.638179:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845837.638191:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcd3a27d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740738982784:0@lo:103: 00000100:00100000:1.0:1788845837.638268:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1cd7030 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738982144:0@lo:104: 00000100:00100000:1.0:1788845837.638278:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041e3f565 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738982272:0@lo:104: 00000100:00100000:1.0:1788845837.638285:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002f29996b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738982400:0@lo:104: 00010000:00010000:1.0:1788845837.638314:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845837.639389:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845837.665905:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738982656 00000100:00100000:1.0:1788845837.665921:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738982656 00010000:00010000:1.0:1788845837.665956:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000095f7a341/0x1345bc80c773ec20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ec19 expref: 13 pid: 5838 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.665981:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738982784 00000100:00100000:1.0:1788845837.665984:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738982784 00010000:00010000:1.0:1788845837.665994:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f9b21b5d/0x1345bc80c773ec3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ec35 expref: 14 pid: 5838 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.666008:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845837.666015:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5a8453a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:3309:x1875740738982528:12345-0@lo:103: 00010000:00010000:1.0:1788845837.666028:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845837.666032:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008dc6365a/0x1345bc80c773ecac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773eca5 expref: 14 pid: 5840 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666043:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008dc6365a/0x1345bc80c773ecac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773eca5 expref: 14 pid: 5840 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666059:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008dc6365a/0x1345bc80c773ecac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773eca5 expref: 14 pid: 5840 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666073:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845837.666139:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5a8453a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:3309:x1875740738982528:12345-0@lo:103: Request processed in 124us (28234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845837.666146:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845837.666185:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845837.666202:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5593838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:3309:x1875740738982656:12345-0@lo:103: 00010000:00010000:1.0:1788845837.666210:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845837.666213:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000095f7a341/0x1345bc80c773ec20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ec19 expref: 12 pid: 5838 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666221:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000095f7a341/0x1345bc80c773ec20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ec19 expref: 12 pid: 5838 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845837.666226:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788845837.666230:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000095f7a341/0x1345bc80c773ec20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ec19 expref: 12 pid: 5838 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666238:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845837.666246:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788845837.666261:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5593838 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:3309:x1875740738982656:12345-0@lo:103: Request processed in 61us (28299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845837.666267:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845837.666280:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788845837.666284:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3217492 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:3307:x1875740738982784:12345-0@lo:103: 00010000:00010000:1.0:1788845837.666290:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845837.666293:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f9b21b5d/0x1345bc80c773ec3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ec35 expref: 10 pid: 5838 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666302:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f9b21b5d/0x1345bc80c773ec3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ec35 expref: 10 pid: 5838 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666309:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f9b21b5d/0x1345bc80c773ec3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ec35 expref: 10 pid: 5838 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666319:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666334:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666345:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666351:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666356:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666362:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666367:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006ccaf0a0 already unused, calling callback (0000000046363818) 00010000:00010000:1.0:1788845837.666371:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666377:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666388:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.666397:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845837.666411:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.666419:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.666424:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3217492 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:3307:x1875740738982784:12345-0@lo:103: Request processed in 140us (27039us total) trans 0 rc 0/0 00010000:00010000:0.0:1788845837.666424:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006ccaf0a0/0x1345bc80c773ecf9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.666431:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:0.0:1788845837.666438:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788845837.666665:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0b43e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738982656:0@lo:103: 00000100:00100000:3.0:1788845837.666676:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738982528:0@lo:103: 00000100:00100000:3.0:1788845837.667253:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcd3a27d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740738982784:0@lo:103: 00000100:00100000:2.0:1788845837.775055:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007891e086 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+8:6686:x1875740738982016:12345-0@lo:253: Request processed in 184905us (185376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.775069:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788845837.775196:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041368e5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738982016:0@lo:253: 10000000:01000000:0.0:1788845837.775210:0:6686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788845837.775213:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788845837.775215:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788845837.775217:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845837.775218:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788845837.775219:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845837.775220:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845837.775221:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845837.775222:0:6686:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788845837.775224:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845837.775225:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788845837.775242:0:6686:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007aec08e8 from lustre-OST0000 10000000:01000000:0.0:1788845837.775276:0:6686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788845837.775279:0:6686:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788845837.775284:0:6686:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a0c088c4d28 local copy 10000000:01000000:0.0:1788845837.775288:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788845837.775475:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.775486:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.775495:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845837.775513:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041368e5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738982912:0@lo:101: 00000100:00100000:2.0:1788845837.775558:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.775621:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007a88f16 going to sleep for 11 seconds 00000100:00100000:0.0:1788845837.775751:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738982912 00000100:00100000:0.0:1788845837.775758:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738982912 00000100:00100000:0.0:1788845837.775806:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788845837.775813:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b727344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+8:6686:x1875740738982912:12345-0@lo:101: 00010000:00010000:0.0:1788845837.775823:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845837.775834:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002305dab6/0x1345bc80c773ed07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ed00 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.775852:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002305dab6/0x1345bc80c773ed07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ed00 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.775861:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002305dab6/0x1345bc80c773ed07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed00 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.775869:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002305dab6, rc 0) 00000100:00100000:0.0:1788845837.775906:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b727344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:6686:x1875740738982912:12345-0@lo:101: Request processed in 94us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845837.775912:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788845837.775984:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041368e5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738982912:0@lo:101: 00010000:00010000:1.0:1788845837.776001:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1345bc80c773ed07 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.776010:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1345bc80c773ed07 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.776100:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002f29996b pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983040:0@lo:501: 00000100:00100000:1.0:1788845837.776125:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845837.776150:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d87a167 going to sleep for 11 seconds 00000100:00100000:0.0:1788845837.776280:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738983040 00000100:00100000:0.0:1788845837.776285:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738983040 00000100:00100000:0.0:1788845837.776436:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788845837.776442:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3c9d327 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:6686:x1875740738983040:12345-0@lo:501: 00000100:00100000:0.0:1788845837.776643:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3c9d327 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:6686:x1875740738983040:12345-0@lo:501: Request processed in 201us (516us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788845837.776649:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788845837.776942:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002f29996b pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983040:0@lo:501: 10000000:01000000:0.0:1788845837.776957:0:6686:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788845837.776984:0:6686:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788845837.776988:0:6686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1345bc80c773ed07 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.776995:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1345bc80c773ed07 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.777000:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1345bc80c773ed07 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.777054:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788845837.777072:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a0c3c96b800 10000000:01000000:0.0:1788845837.777077:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788845837.777081:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a0c088c4d28 10000000:01000000:0.0:1788845837.777083:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788845837.777086:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a0c088c4d28 from 1 10000000:01000000:0.0:1788845837.777088:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788845837.777103:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 0000000065cf2322/0x1345bc80c773ed0e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.777110:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 0000000065cf2322/0x1345bc80c773ed0e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.777117:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 0000000065cf2322/0x1345bc80c773ed0e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845837.777128:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f68a49a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983168:0@lo:101: 00010000:00010000:2.0:1788845837.777237:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845837.777242:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1345bc80c773ed07 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.777249:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c4a5ff33 already unused, calling callback (000000005573eee6) 10000000:00010000:2.0:1788845837.777252:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1345bc80c773ed07 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.777259:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x1345bc80c773ed07 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845837.777265:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x1345bc80c773ed07 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845837.777270:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788845837.777404:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845837.777488:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738983168 00000100:00100000:1.0:1788845837.777493:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738983168 00000100:00100000:2.0:1788845837.777653:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788845837.777661:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f6927fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:6686:x1875740738983168:12345-0@lo:101: 00010000:00010000:2.0:1788845837.777671:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845837.777682:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000023df5b10/0x1345bc80c773ed15 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ed0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.777696:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000023df5b10/0x1345bc80c773ed15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ed0e expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.777703:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000023df5b10/0x1345bc80c773ed15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed0e expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.777709:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000023df5b10, rc 0) 00000100:00100000:2.0:1788845837.777733:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f6927fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:6686:x1875740738983168:12345-0@lo:101: Request processed in 74us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.777743:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788845837.777813:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c26030e going to sleep for 11 seconds 00000100:00100000:1.0:1788845837.777829:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f68a49a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983168:0@lo:101: 00010000:00010000:1.0:1788845837.777838:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 0000000065cf2322/0x1345bc80c773ed0e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed15 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.777845:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 0000000065cf2322/0x1345bc80c773ed0e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ed15 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845837.777880:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788845837.777898:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 0000000065cf2322/0x1345bc80c773ed0e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed15 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.777904:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 0000000065cf2322/0x1345bc80c773ed0e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed15 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845837.777910:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788845837.777913:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788845837.777917:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788845837.777924:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788845837.777940:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 0000000095f7a341/0x1345bc80c773ed1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.777946:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 0000000095f7a341/0x1345bc80c773ed1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.777952:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 0000000095f7a341/0x1345bc80c773ed1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.777963:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041e3f565 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983296:0@lo:101: 00000100:00100000:1.0:1788845837.777986:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845837.778051:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d175c80 going to sleep for 11 seconds 00010000:00010000:3.0:1788845837.778143:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1345bc80c773ed07 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.778150:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845837.778190:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1345bc80c773ed07 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.778197:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1345bc80c773ed07 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.778210:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845837.778212:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845837.778214:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845837.778255:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcd3a27d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740738983424:0@lo:103: 00000100:00100000:2.0:1788845837.778284:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.778446:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738983424 00000100:00100000:3.0:1788845837.778451:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738983424 00000100:00100000:3.0:1788845837.778490:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845837.778497:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014f04dbf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:3308:x1875740738983424:12345-0@lo:103: 00010000:00010000:3.0:1788845837.778513:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845837.778940:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002305dab6/0x1345bc80c773ed07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773ed00 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.778955:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845837.778998:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014f04dbf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:3308:x1875740738983424:12345-0@lo:103: Request processed in 502us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.779005:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845837.779067:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcd3a27d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740738983424:0@lo:103: 00000100:00100000:0.0:1788845837.779131:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738983296 00000100:00100000:0.0:1788845837.779136:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738983296 00000100:00100000:2.0:1788845837.779464:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788845837.779471:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000733e50e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:6686:x1875740738983296:12345-0@lo:101: 00010000:00010000:2.0:1788845837.779481:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845837.779491:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d52f36d3/0x1345bc80c773ed23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ed1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.779505:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d52f36d3/0x1345bc80c773ed23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ed1c expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.779513:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d52f36d3/0x1345bc80c773ed23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed1c expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.779519:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d52f36d3, rc 0) 00000100:00100000:2.0:1788845837.779713:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000733e50e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:6686:x1875740738983296:12345-0@lo:101: Request processed in 243us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.779719:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788845837.779781:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041e3f565 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983296:0@lo:101: 00010000:00010000:1.0:1788845837.779793:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 0000000095f7a341/0x1345bc80c773ed1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed23 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.779801:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 0000000095f7a341/0x1345bc80c773ed1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ed23 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.779885:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041e3f565 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983552:0@lo:501: 00000100:00100000:1.0:1788845837.779913:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845837.779977:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d175c80 going to sleep for 11 seconds 00000100:00100000:0.0:1788845837.780010:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738983552 00000100:00100000:0.0:1788845837.780015:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738983552 00000100:00100000:0.0:1788845837.780080:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788845837.780087:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b650c644 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:6686:x1875740738983552:12345-0@lo:501: 00000100:00100000:0.0:1788845837.782512:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b650c644 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:6686:x1875740738983552:12345-0@lo:501: Request processed in 2421us (2593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845837.782534:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788845837.782639:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041e3f565 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983552:0@lo:501: 00000100:00100000:3.0:1788845837.782684:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983680:0@lo:503: 00000100:00100000:3.0:1788845837.782724:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.783015:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 00000000714d957f going to sleep for 11 seconds 00000100:00100000:2.0:1788845837.783095:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738983680 00000100:00100000:2.0:1788845837.783101:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738983680 00000100:00100000:2.0:1788845837.783133:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788845837.783140:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be09cc5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:6686:x1875740738983680:12345-0@lo:503: 00000100:00100000:2.0:1788845837.783418:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be09cc5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:6686:x1875740738983680:12345-0@lo:503: Request processed in 279us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.783434:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788845837.783517:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983680:0@lo:503: 00000040:00080000:3.0:1788845837.783775:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788845837.783826:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983808:0@lo:502: 00000100:00100000:3.0:1788845837.783860:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.783889:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 00000000714d957f going to sleep for 11 seconds 00000100:00100000:2.0:1788845837.784030:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738983808 00000100:00100000:2.0:1788845837.784035:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738983808 00000100:00100000:2.0:1788845837.784054:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788845837.784059:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029f29f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:6686:x1875740738983808:12345-0@lo:502: 00000100:00100000:2.0:1788845837.784219:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029f29f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:6686:x1875740738983808:12345-0@lo:502: Request processed in 160us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.784225:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788845837.784393:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983808:0@lo:502: 00000040:00080000:3.0:1788845837.784802:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788845837.784854:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788845837.784902:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788845837.784949:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788845837.784987:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788845837.785024:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788845837.785048:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983936:0@lo:502: 00000100:00100000:3.0:1788845837.785086:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.785124:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 00000000714d957f going to sleep for 11 seconds 00000100:00100000:2.0:1788845837.785182:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738983936 00000100:00100000:2.0:1788845837.785187:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738983936 00000100:00100000:2.0:1788845837.785211:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788845837.785217:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d66dddf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:6686:x1875740738983936:12345-0@lo:502: 00000100:00100000:2.0:1788845837.785437:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d66dddf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:6686:x1875740738983936:12345-0@lo:502: Request processed in 220us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.785444:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788845837.785773:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738983936:0@lo:502: 00000040:00080000:3.0:1788845837.785857:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788845837.785867:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1788845837.786695:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788845837.786702:0:6706:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788845837.786709:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845837.786711:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788845837.786716:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788845837.786737:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000004649d832) 00000020:00000080:3.0:1788845837.786755:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788845837.786772:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788845837.786833:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007aec08e8 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788845837.786840:0:6706:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788845837.786848:0:6706:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1345bc80c773ed31 00010000:00010000:3.0:1788845837.791395:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788845837.791798:0:6706:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788845837.796998:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788845837.803797:0:6706:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 10000000:01000000:2.0:1788845837.818410:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788845837.818417:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a0c0942a000 from 21 10000000:01000000:2.0:1788845837.818422:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788845837.818465:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.818477:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.818487:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845837.818509:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004154df0e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738984064:0@lo:101: 00000100:00100000:2.0:1788845837.818711:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.818812:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e97bda0f going to sleep for 11 seconds 00000100:00100000:0.0:1788845837.818895:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738984064 00000100:00100000:0.0:1788845837.818902:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738984064 00000100:00100000:0.0:1788845837.818958:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788845837.818966:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4c41b5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+10:5842:x1875740738984064:12345-0@lo:101: 00010000:00010000:0.0:1788845837.818989:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845837.819002:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000039b597a7/0x1345bc80c773ed3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ed38 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.819025:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039b597a7/0x1345bc80c773ed3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ed38 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.819045:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000039b597a7/0x1345bc80c773ed3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed38 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.819054:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000039b597a7, rc 0) 00000100:00100000:0.0:1788845837.819120:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4c41b5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:5842:x1875740738984064:12345-0@lo:101: Request processed in 156us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845837.819128:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788845837.819743:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004154df0e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738984064:0@lo:101: 00010000:00010000:2.0:1788845837.819769:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.819779:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ed3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845837.819832:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004154df0e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738984192:0@lo:501: 00000100:00100000:2.0:1788845837.819874:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.819989:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e97bda0f going to sleep for 11 seconds 00080000:10000000:2.0:1788845837.821907:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788845837.822364:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000100:00100000:0.0:1788845837.825879:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738984192 00000100:00100000:0.0:1788845837.825894:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738984192 00000100:00100000:0.0:1788845837.825958:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788845837.825966:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f2fbd2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:5842:x1875740738984192:12345-0@lo:501: 00000100:00100000:0.0:1788845837.826246:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f2fbd2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:5842:x1875740738984192:12345-0@lo:501: Request processed in 280us (6371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845837.826253:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788845837.826886:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004154df0e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738984192:0@lo:501: 00000100:00100000:3.0:1788845837.826938:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738984320:0@lo:503: 00000100:00100000:3.0:1788845837.826987:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.827013:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a3b1927 going to sleep for 11 seconds 00000100:00100000:2.0:1788845837.827407:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738984320 00000100:00100000:2.0:1788845837.827413:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738984320 00000100:00100000:2.0:1788845837.827439:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788845837.827445:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029b791f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:5842:x1875740738984320:12345-0@lo:503: 00000100:00100000:2.0:1788845837.827618:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029b791f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:5842:x1875740738984320:12345-0@lo:503: Request processed in 173us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.827625:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788845837.827891:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000746abf0e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738984320:0@lo:503: 00000020:00000080:3.0:1788845837.829538:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788845837.829548:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845837.829553:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845837.829555:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788845837.829558:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845837.829567:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845837.829569:0:6706:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788845837.829573:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788845837.829574:0:6706:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788845837.829875:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845837.829879:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845837.829881:0:6706:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788845837.829884:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788845837.830862:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788845837.830892:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788845837.830901:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 0000000095f7a341/0x1345bc80c773ed1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed23 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.830912:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 0000000095f7a341/0x1345bc80c773ed1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed23 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845837.830926:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c3c96b800 from 1 10000000:01000000:2.0:1788845837.830929:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788845837.830970:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000e44e5902/0x1345bc80c773ed46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.830978:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000e44e5902/0x1345bc80c773ed46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.830987:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000e44e5902/0x1345bc80c773ed46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845837.831010:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c8b522f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738984448:0@lo:101: 00000100:00100000:2.0:1788845837.831072:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.831105:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099e7e44e going to sleep for 11 seconds 00000100:00100000:0.0:1788845837.831180:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738984448 00000100:00100000:0.0:1788845837.831187:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738984448 00000100:00100000:0.0:1788845837.831230:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788845837.831239:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae8683b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:6686:x1875740738984448:12345-0@lo:101: 00010000:00010000:0.0:1788845837.831251:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845837.831262:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006940cc2b/0x1345bc80c773ed4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ed46 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.831281:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006940cc2b/0x1345bc80c773ed4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ed46 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.831291:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006940cc2b/0x1345bc80c773ed4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed46 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.831299:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006940cc2b, rc 0) 00000100:00100000:0.0:1788845837.831346:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae8683b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:6686:x1875740738984448:12345-0@lo:101: Request processed in 108us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845837.831353:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788845837.831575:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c8b522f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738984448:0@lo:101: 00010000:00010000:2.0:1788845837.832683:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000e44e5902/0x1345bc80c773ed46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed4d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.832693:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000e44e5902/0x1345bc80c773ed46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ed4d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845837.832907:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c8b522f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738984576:0@lo:501: 00000100:00100000:2.0:1788845837.832949:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.832984:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099e7e44e going to sleep for 11 seconds 00000100:00100000:0.0:1788845837.833455:0:6708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cce29eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6708:1875740738984704:0@lo:502: 00000100:00100000:0.0:1788845837.833494:0:6708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845837.833517:0:6708:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e223e2fb going to sleep for 11 seconds 00000100:00100000:3.0:1788845837.833680:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738984576 00000100:00100000:3.0:1788845837.833687:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738984576 00000100:00100000:3.0:1788845837.833716:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738984704 00000100:00100000:3.0:1788845837.833820:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738984704 00000100:00100000:3.0:1788845837.833840:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788845837.833846:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c74a02a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:6686:x1875740738984576:12345-0@lo:501: 00000100:00100000:3.0:1788845837.834061:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c74a02a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:6686:x1875740738984576:12345-0@lo:501: Request processed in 214us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.834068:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788845837.834091:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788845837.834097:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdda96a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:6708:x1875740738984704:12345-0@lo:502: 00000100:00100000:3.0:1788845837.834288:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdda96a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:6708:x1875740738984704:12345-0@lo:502: Request processed in 191us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.834294:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788845837.834712:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c8b522f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738984576:0@lo:501: 00000100:00100000:2.0:1788845837.834854:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c8b522f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738984832:0@lo:503: 00000100:00100000:2.0:1788845837.834902:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.834924:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099e7e44e going to sleep for 11 seconds 00000100:00100000:2.0:1788845837.834940:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738984832 00000100:00100000:2.0:1788845837.834944:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738984832 00000100:00100000:2.0:1788845837.834966:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788845837.834972:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a15bed0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:6686:x1875740738984832:12345-0@lo:503: 00000100:00100000:2.0:1788845837.835148:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a15bed0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:6686:x1875740738984832:12345-0@lo:503: Request processed in 176us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.835171:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788845837.835215:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c8b522f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738984832:0@lo:503: 00000100:00100000:0.0:1788845837.835948:0:6708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cce29eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6708:1875740738984704:0@lo:502: 00000100:00100000:0.0:1788845837.835994:0:6708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cce29eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6708:1875740738984960:0@lo:502: 00000100:00100000:0.0:1788845837.836033:0:6708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845837.836056:0:6708:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e223e2fb going to sleep for 11 seconds 00000100:00100000:3.0:1788845837.836683:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738984960 00000100:00100000:3.0:1788845837.836689:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738984960 00000100:00100000:3.0:1788845837.836712:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788845837.836891:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068225952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:6708:x1875740738984960:12345-0@lo:502: 00000100:00100000:3.0:1788845837.837128:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068225952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:6708:x1875740738984960:12345-0@lo:502: Request processed in 410us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.837136:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:2.0:1788845837.837949:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788845837.838013:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c8b522f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738985088:0@lo:502: 00000100:00100000:2.0:1788845837.838061:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.838091:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099e7e44e going to sleep for 11 seconds 00000100:00100000:2.0:1788845837.838113:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738985088 00000100:00100000:2.0:1788845837.838119:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738985088 00000100:00100000:2.0:1788845837.838145:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788845837.838181:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091049aca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:6686:x1875740738985088:12345-0@lo:502: 00000100:00100000:2.0:1788845837.838349:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091049aca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:6686:x1875740738985088:12345-0@lo:502: Request processed in 169us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.838357:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788845837.838406:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c8b522f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738985088:0@lo:502: 00000040:00080000:2.0:1788845837.841118:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788845837.841219:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788845837.841264:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c8b522f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738985216:0@lo:502: 00000100:00100000:2.0:1788845837.842010:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.842059:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099e7e44e going to sleep for 11 seconds 00000100:00100000:2.0:1788845837.842088:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738985216 00000100:00100000:2.0:1788845837.842095:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738985216 00000100:00100000:2.0:1788845837.842133:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788845837.842141:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa2c9308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:6686:x1875740738985216:12345-0@lo:502: 00000100:00100000:0.0:1788845837.844891:0:6708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cce29eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6708:1875740738984960:0@lo:502: 00000100:00100000:3.0:1788845837.846220:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c8b522f pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738985216:0@lo:502: 00000040:00080000:3.0:1788845837.846375:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788845837.846390:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000040:00080000:1.0:1788845837.847401:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788845837.847791:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788845837.847812:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845837.847820:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.847832:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000c4a5ff33/0x1345bc80c773ed38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845837.847841:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788845837.847843:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788845837.847845:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788845837.847873:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000069ee8b3/0x1345bc80c773ed54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.847880:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000069ee8b3/0x1345bc80c773ed54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.847889:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000069ee8b3/0x1345bc80c773ed54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845837.847907:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cce29eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738985344:0@lo:101: 00000100:00100000:0.0:1788845837.853017:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845837.853060:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ebe0a471 going to sleep for 11 seconds 00000100:00100000:0.0:1788845837.853098:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738985344 00000100:00100000:0.0:1788845837.853110:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738985344 00000100:00100000:0.0:1788845837.853176:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788845837.853186:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067cb2143 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:5842:x1875740738985344:12345-0@lo:101: 00010000:00010000:0.0:1788845837.853208:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845837.853229:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008c0861f7/0x1345bc80c773ed5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ed54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1788845837.853236:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845837.853247:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845837.853250:0:6711:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788845837.853256:0:6711:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a0c3c96b800 00000020:00000080:1.0:1788845837.853259:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00010000:00010000:0.0:1788845837.853282:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c00030c00/0x1345bc80c773ed5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ed54 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1788845837.853296:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00010000:00010000:0.0:1788845837.853296:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c00030c00/0x1345bc80c773ed5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed54 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.853307:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030c00, rc 0) 00000020:00000080:1.0:1788845837.853320:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845837.853322:0:6711:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788845837.853326:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000100:00100000:0.0:1788845837.853353:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:5842:x1875740738985344:12345-0@lo:101: Request processed in 168us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845837.853361:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788845837.853414:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738985344:0@lo:101: 00010000:00010000:0.0:1788845837.853440:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c00031600/0x1345bc80c773ed54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.853450:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c00031600/0x1345bc80c773ed54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ed5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1788845837.853454:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788845837.853485:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845837.853493:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02825000/0x1345bc80c773ed46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed4d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845837.853520:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:6686:x1875740738985216:12345-0@lo:502: Request processed in 11377us (11508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845837.853531:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738985472:0@lo:501: 00000100:00100000:2.0:1788845837.853545:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788845837.853568:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845837.853597:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b0421dd80 going to sleep for 11 seconds 00010000:00010000:3.0:1788845837.853647:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c02825000/0x1345bc80c773ed46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed4d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845837.853689:0:6686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788845837.853692:0:6686:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a0c3c96b800 10000000:01000000:3.0:1788845837.853695:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a0c3c96b800 10000000:01000000:3.0:1788845837.853698:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788845837.853703:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a0c3c96b800 from 1 10000000:01000000:3.0:1788845837.853705:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788845837.853724:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.853732:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.853741:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845837.853754:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738985600:0@lo:101: 00000100:00100000:3.0:1788845837.853813:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.858977:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738985472 00000100:00100000:2.0:1788845837.858991:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738985472 00000100:00100000:2.0:1788845837.859052:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788845837.859062:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:5842:x1875740738985472:12345-0@lo:501: 00000100:00100000:3.0:1788845837.859204:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845837.859460:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:5842:x1875740738985472:12345-0@lo:501: Request processed in 399us (5891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.859468:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788845837.859491:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738985600 00000100:00100000:2.0:1788845837.859495:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738985600 00000100:00100000:2.0:1788845837.859511:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788845837.859518:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:6686:x1875740738985600:12345-0@lo:101: 00010000:00010000:2.0:1788845837.860402:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845837.860422:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773ed69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ed62 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.860449:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773ed69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ed62 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.860459:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773ed69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed62 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.860482:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02824c00, rc 0) 00000100:00100000:2.0:1788845837.860661:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:6686:x1875740738985600:12345-0@lo:101: Request processed in 1006us (6711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.860668:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788845837.860909:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738985472:0@lo:501: 00000100:00100000:3.0:1788845837.860964:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738985728:0@lo:503: 00000100:00100000:3.0:1788845837.861010:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.861044:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788845837.861070:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738985600:0@lo:101: 00010000:00010000:3.0:1788845837.861083:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed69 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.861093:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ed69 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845837.861204:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738985856:0@lo:501: 00000100:00100000:3.0:1788845837.861229:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.861245:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845837.861299:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738985728 00000100:00100000:0.0:1788845837.861409:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738985856 00000100:00100000:0.0:1788845837.861415:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738985856 00000100:00100000:0.0:1788845837.861457:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788845837.861465:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:6686:x1875740738985856:12345-0@lo:501: 00000100:00100000:2.0:1788845837.861978:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738985728 00000100:00100000:2.0:1788845837.862003:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788845837.862009:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740738985728:12345-0@lo:503: 00000100:00100000:2.0:1788845837.862204:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740738985728:12345-0@lo:503: Request processed in 194us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.862211:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788845837.862261:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738985728:0@lo:503: 00000100:00100000:0.0:1788845837.862610:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:6686:x1875740738985856:12345-0@lo:501: Request processed in 1145us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845837.862618:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788845837.864501:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738985856:0@lo:501: 00000100:00100000:3.0:1788845837.865672:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738985984:0@lo:503: 00000100:00100000:3.0:1788845837.865743:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.865788:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845837.866403:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738985984 00000100:00100000:1.0:1788845837.866410:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738985984 00000100:00100000:1.0:1788845837.866462:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788845837.866470:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:6686:x1875740738985984:12345-0@lo:503: 00000100:00100000:1.0:1788845837.866655:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:6686:x1875740738985984:12345-0@lo:503: Request processed in 185us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845837.866662:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788845837.867451:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738985984:0@lo:503: 00000040:00080000:3.0:1788845837.867751:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788845837.867824:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738986112:0@lo:502: 00000100:00100000:3.0:1788845837.867867:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.867896:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738986112 00000100:00100000:3.0:1788845837.867901:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738986112 00000100:00100000:3.0:1788845837.867928:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788845837.867934:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:6686:x1875740738986112:12345-0@lo:502: 00000100:00100000:3.0:1788845837.868108:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:6686:x1875740738986112:12345-0@lo:502: Request processed in 173us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.868115:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788845837.868180:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788845837.868194:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738986112:0@lo:502: 00000040:00080000:3.0:1788845837.868450:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788845837.868499:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788845837.868537:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788845837.868597:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788845837.868643:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788845837.868693:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788845837.868732:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788845837.868781:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788845837.868846:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788845837.868899:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788845837.868938:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788845837.868993:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788845837.869032:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788845837.869066:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788845837.869111:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788845837.869150:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788845837.869216:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788845837.869264:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788845837.869299:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788845837.869333:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788845837.869382:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788845837.869418:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788845837.869452:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788845837.869512:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788845837.869551:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788845837.869601:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788845837.869661:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788845837.869693:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788845837.869724:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738986240:0@lo:502: 00000100:00100000:3.0:1788845837.869790:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.869832:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738986240 00000100:00100000:3.0:1788845837.869838:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738986240 00000100:00100000:3.0:1788845837.869885:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788845837.869894:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:6686:x1875740738986240:12345-0@lo:502: 00000100:00100000:3.0:1788845837.870051:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:6686:x1875740738986240:12345-0@lo:502: Request processed in 158us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.870058:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788845837.870102:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788845837.870118:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738986240:0@lo:502: 00000040:00080000:3.0:1788845837.870203:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788845837.870212:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000100:00100000:0.0:1788845837.871889:0:6712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da25c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6712:1875740738986368:0@lo:502: 00000100:00100000:0.0:1788845837.871954:0:6712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845837.871991:0:6712:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b0421d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845837.872077:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738986368 00000100:00100000:2.0:1788845837.872084:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738986368 00000100:00100000:2.0:1788845837.872130:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788845837.872138:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:6712:x1875740738986368:12345-0@lo:502: 00000100:00100000:2.0:1788845837.872378:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:6712:x1875740738986368:12345-0@lo:502: Request processed in 240us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.872385:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788845837.872436:0:6712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da25c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6712:1875740738986368:0@lo:502: 00000020:01000000:2.0:1788845837.872465:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788845837.872472:0:6712:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788845837.872478:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845837.872481:0:6712:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788845837.872485:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788845837.872495:0:6712:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:2.0:1788845837.872516:0:6712:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788845837.872519:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788845837.872545:0:6712:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a0c089a3370) 00000020:00000080:2.0:1788845837.872564:0:6712:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osp with refcount 2 00000020:00000080:2.0:1788845837.872570:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788845837.872629:0:6712:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788845837.872634:0:6712:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788845837.872641:0:6712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773ed77 00010000:00080000:2.0:1788845837.872667:0:6712:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a0b04977800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:2.0:1788845837.872915:0:6712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000020:01000004:3.0:1788845837.881385:0:6713:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788845837.881401:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a0c351799b8) 00000020:00000080:3.0:1788845837.881421:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lwp with refcount 2 00000020:01000004:3.0:1788845837.881489:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a0c3c96b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788845837.881493:0:6713:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a0c3c96b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788845837.881496:0:6713:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a0c3c96b800 3 00010000:00080000:3.0:1788845837.881634:0:6713:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a0c3d8b5000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1788845837.884617:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-3 is initialized 00000020:00000080:3.0:1788845837.887409:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788845837.887471:0:6713:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788845837.887483:0:6713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1345bc80c773ed85 00000100:00080000:3.0:1788845837.887493:0:6713:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788845837.887498:0:6713:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a0c3d8b5000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1788845837.887609:0:6713:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3d9edf80 x1875740738986496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788845837.887646:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875740738986496:0@lo:38: 00000100:00100000:3.0:1788845837.887709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.887806:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738986496 00000100:00100000:3.0:1788845837.887813:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738986496 00000100:00100000:3.0:1788845837.887843:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845837.887850:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875740738986496:12345-0@lo:38: 00010000:00080000:3.0:1788845837.887873:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1788845837.887915:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1345bc80c773ed8c 00000004:00100000:3.0:1788845837.887928:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788845837.887954:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9a0c3536a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845837.887998:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875740738986496:12345-0@lo:38: Request processed in 147us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.888005:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788845837.888041:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a0c3d9edf80 x1875740738986496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845837.888051:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788845837.888058:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788845837.888064:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788845837.888067:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788845837.888069:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d8b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788845837.888075:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875740738986496:0@lo:38: 00000100:00080000:3.0:1788845837.888095:0:6713:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788845837.888144:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740738986624:0@lo:400: 00000100:00100000:3.0:1788845837.888204:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.888240:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738986624 00000100:00100000:3.0:1788845837.888244:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738986624 00000100:00100000:3.0:1788845837.888268:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845837.888274:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740738986624:12345-0@lo:400: 00000100:00100000:3.0:1788845837.890905:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740738986624:12345-0@lo:400: Request processed in 2624us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.890917:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788845837.890973:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a0c3d9edf80 x1875740738986624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845837.890988:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740738986624:0@lo:400: 00000040:00080000:0.0:1788845837.892286:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788845837.892350:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788845837.892377:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845837.892388:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed69 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.892399:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed69 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788845837.892442:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788845837.892444:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788845837.892446:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845837.892447:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845837.892448:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845837.892449:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845837.892451:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845837.892452:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845837.892454:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845837.892455:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845837.892456:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788845837.892459:0:6686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788845837.892462:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788845837.892463:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788845837.892464:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845837.892465:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845837.892466:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845837.892467:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845837.892473:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845837.892474:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845837.892475:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845837.892476:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845837.892477:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788845837.892534:0:6686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788845837.892551:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738986752:0@lo:253: 00000100:00100000:0.0:1788845837.892609:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845837.892646:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b0421de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845837.892935:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738986752 00000100:00100000:2.0:1788845837.892943:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738986752 00000100:00100000:2.0:1788845837.892979:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788845837.892987:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:6686:x1875740738986752:12345-0@lo:253: 20000000:01000000:2.0:1788845837.893023:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788845837.893036:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000040:01000000:2.0:1788845837.919030:0:6712:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788845837.919052:0:6712:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788845837.919575:0:6712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788845837.919752:0:6712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788845837.919832:0:6712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788845837.919890:0:6712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788845837.922357:0:6716:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845837.922363:0:6716:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788845837.925963:0:6712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788845837.925977:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788845837.926014:0:6712:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788845837.926036:0:6712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1345bc80c773ed93 00000100:00080000:0.0:1788845837.926066:0:6712:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788845837.926072:0:6712:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a0b04977800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1788845837.926107:0:6712:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3da25880 x1875740738986880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788845837.926129:0:6712:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788845837.926212:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845837.926216:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845837.926218:0:6712:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788845837.926221:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845837.926225:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845837.926226:0:6712:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788845837.926228:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788845837.926230:0:6712:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788845837.926257:0:6712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6712:1875740738987008:0@lo:502: 00000100:00100000:0.0:1788845837.926338:0:6712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845837.926374:0:6712:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b0421d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845837.926399:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740738986880:0@lo:8: 00000100:00100000:0.0:1788845837.926429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845837.926619:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738987008 00000100:00100000:1.0:1788845837.926626:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738987008 00000100:00100000:1.0:1788845837.926662:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788845837.926670:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:6712:x1875740738987008:12345-0@lo:502: 00000100:00100000:1.0:1788845837.926938:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:6712:x1875740738987008:12345-0@lo:502: Request processed in 267us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845837.926946:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788845837.926987:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738986880 00000100:00100000:1.0:1788845837.926992:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738986880 00000100:00100000:1.0:1788845837.927013:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845837.927018:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875740738986880:12345-0@lo:8: 00000100:00100000:1.0:1788845837.927064:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875740738986880:12345-0@lo:8: Request processed in 44us (633us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788845837.927070:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845837.927108:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788845837.927136:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0b04977800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788845837.927140:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788845837.927144:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740738986880:0@lo:8: 00000100:00100000:0.0:1788845837.927834:0:6712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6712:1875740738987008:0@lo:502: 00000020:01000000:0.0:1788845837.927859:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845837.927864:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845837.927866:0:6712:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788845837.927870:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788845837.928062:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788845837.928082:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788845837.928092:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c00031600/0x1345bc80c773ed54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.928103:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c00031600/0x1345bc80c773ed54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ed5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845837.928123:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788845837.928125:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c0942a000 from 1 10000000:01000000:2.0:1788845837.928128:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788845837.928616:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.928627:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.928637:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845837.928655:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738987136:0@lo:101: 00000100:00100000:2.0:1788845837.928697:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.928734:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200ae0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845837.929400:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738987136 00000100:00100000:0.0:1788845837.929407:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738987136 00000100:00100000:0.0:1788845837.929446:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788845837.929454:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740738987136:12345-0@lo:101: 00010000:00010000:0.0:1788845837.929466:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845837.929478:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c00030000/0x1345bc80c773eda1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ed9a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.929500:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c00030000/0x1345bc80c773eda1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ed9a expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.929510:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c00030000/0x1345bc80c773eda1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed9a expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.929519:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030000, rc 0) 00000100:00100000:0.0:1788845837.929692:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738987136:12345-0@lo:101: Request processed in 239us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845837.929699:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788845837.930101:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738987136:0@lo:101: 00010000:00010000:2.0:1788845837.930116:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773eda1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.930126:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773eda1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845837.930471:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738987264:0@lo:501: 00000100:00100000:2.0:1788845837.930505:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.931099:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200ae0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845837.931186:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738987264 00000100:00100000:3.0:1788845837.931191:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738987264 00000100:00100000:3.0:1788845837.931226:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788845837.931234:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738987264:12345-0@lo:501: 00000100:00100000:3.0:1788845837.931473:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738987264:12345-0@lo:501: Request processed in 239us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.931480:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788845837.932139:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738987264:0@lo:501: 00000100:00100000:2.0:1788845837.932188:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738987392:0@lo:503: 00000100:00100000:2.0:1788845837.932240:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.932261:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200ae0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845837.932699:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738987392 00000100:00100000:3.0:1788845837.932705:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738987392 00000100:00100000:3.0:1788845837.932730:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788845837.932737:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738987392:12345-0@lo:503: 00000100:00100000:3.0:1788845837.932933:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738987392:12345-0@lo:503: Request processed in 195us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.932940:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788845837.932981:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738987392:0@lo:503: 00000100:00100000:3.0:1788845837.933195:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6718:1875740738987520:0@lo:502: 00000100:00100000:3.0:1788845837.933230:0:6718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.933250:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738987520 00000100:00100000:3.0:1788845837.933254:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738987520 00000100:00100000:3.0:1788845837.933271:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788845837.933277:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:6718:x1875740738987520:12345-0@lo:502: 00000100:00100000:3.0:1788845837.936833:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:6718:x1875740738987520:12345-0@lo:502: Request processed in 3549us (3596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.936866:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788845837.936919:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c17ccd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788845837.936942:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6718:1875740738987520:0@lo:502: 00000020:01000000:3.0:1788845837.936973:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845837.936982:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845837.936984:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788845837.936991:0:6718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a0c0942a000 00000020:00000080:3.0:1788845837.936994:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788845837.937025:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6718:1875740738987648:0@lo:502: 00000100:00100000:3.0:1788845837.937066:0:6718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.937081:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c17ccd540 going to sleep for 11 seconds 00000100:00100000:1.0:1788845837.937637:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738987648 00000100:00100000:1.0:1788845837.937645:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738987648 00000100:00100000:1.0:1788845837.937678:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788845837.937686:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:6718:x1875740738987648:12345-0@lo:502: 00000100:00100000:1.0:1788845837.937865:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:6718:x1875740738987648:12345-0@lo:502: Request processed in 178us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845837.937872:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788845837.938822:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6718:1875740738987648:0@lo:502: 00000020:01000000:3.0:1788845837.938854:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845837.938862:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845837.938864:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788845837.938868:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788845837.940648:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788845837.940677:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845837.940688:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773eda1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.940712:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773eda1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845837.940721:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788845837.940724:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a0c088c4d28 from 1 10000000:01000000:0.0:1788845837.940726:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788845837.940767:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.940775:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.940785:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845837.940805:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738987776:0@lo:101: 00000100:00100000:0.0:1788845837.940857:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845837.940894:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b0421d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788845837.941050:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738987776 00000100:00100000:1.0:1788845837.941057:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738987776 00000100:00100000:1.0:1788845837.941096:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788845837.941104:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738987776:12345-0@lo:101: 00010000:00010000:1.0:1788845837.941114:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845837.941124:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475800/0x1345bc80c773edaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773eda8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.941145:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475800/0x1345bc80c773edaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773eda8 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.941175:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475800/0x1345bc80c773edaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773eda8 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.941183:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475800, rc 0) 00000100:00100000:1.0:1788845837.941214:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740738987776:12345-0@lo:101: Request processed in 111us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845837.941220:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788845837.941408:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738987776:0@lo:101: 00010000:00010000:0.0:1788845837.941421:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773edaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.941430:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773edaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845837.941475:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738987904:0@lo:501: 00000100:00100000:0.0:1788845837.941500:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845837.941596:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b0421d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788845837.941743:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738987904 00000100:00100000:1.0:1788845837.941747:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738987904 00000100:00100000:1.0:1788845837.941784:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788845837.941791:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740738987904:12345-0@lo:501: 00000100:00100000:1.0:1788845837.941985:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740738987904:12345-0@lo:501: Request processed in 194us (484us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788845837.941992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788845837.942262:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738987904:0@lo:501: 10000000:01000000:1.0:1788845837.942286:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788845837.942292:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773edaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.942299:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773edaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788845837.954273:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788845837.954294:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788845837.954470:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788845837.954475:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788845837.954496:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.954514:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c12f56c00/0x1345bc80c773ecd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773eccf expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.954521:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.954568:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c12f56c00/0x1345bc80c773ecd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773eccf expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.954580:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c12f56c00/0x1345bc80c773ecd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773eccf expref: 16 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.954592:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875740738988032:0@lo:104: 00000100:00100000:1.0:1788845837.954659:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.955036:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738988032 00000100:00100000:2.0:1788845837.955044:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738988032 00000100:00100000:2.0:1788845837.955089:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788845837.955098:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:5861:x1875740738988032:12345-0@lo:104: 00010000:00010000:2.0:1788845837.955111:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773eccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ecd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.955178:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788845837.955184:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:5861:x1875740738988032:12345-0@lo:104: Request processed in 87us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845837.955191:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788845837.955212:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845837.955217:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773eccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ecd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.955225:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824400 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788845837.955228:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773eccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ecd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.955236:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773eccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ecd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845837.955243:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773eccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ecd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845837.955249:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845837.955277:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773eccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ecd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.955290:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845837.955321:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773eccf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ecd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.955328:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773eccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ecd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845837.955342:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845837.955343:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845837.955345:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845837.955356:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740738988160:0@lo:103: 00000100:00100000:2.0:1788845837.955387:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845837.955615:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c0771fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845837.955635:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875740738988032:0@lo:104: 00010000:00010000:1.0:1788845837.955654:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.955681:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738988160 00000100:00100000:1.0:1788845837.955685:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738988160 00010000:00010000:1.0:1788845837.955703:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c12f56c00/0x1345bc80c773ecd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773eccf expref: 17 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.955790:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788845837.955797:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26397050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:3310:x1875740738988160:12345-0@lo:103: 00010000:00010000:1.0:1788845837.955806:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845837.955811:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c12f56c00/0x1345bc80c773ecd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773eccf expref: 17 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.955820:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c12f56c00/0x1345bc80c773ecd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773eccf expref: 17 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.955831:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c12f56c00/0x1345bc80c773ecd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773eccf expref: 17 pid: 5838 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.955841:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.955848:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788845837.955858:0:6705:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001383698s 00010000:00010000:1.0:1788845837.955867:0:6705:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.955873:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.955879:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.955884:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.955889:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788845837.955893:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.955898:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.955912:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.955920:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845837.955953:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26397050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:3310:x1875740738988160:12345-0@lo:103: Request processed in 156us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845837.955959:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788845837.956007:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740738988160:0@lo:103: 00010000:00010000:0.0:1788845837.956383:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.956391:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845837.956396:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01474000/0x1345bc80c773edb6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.987057:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:6686:x1875740738986752:12345-0@lo:253: Request processed in 94062us (94440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845837.987070:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788845837.987197:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da24e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:6686:1875740738986752:0@lo:253: 10000000:01000000:2.0:1788845837.987213:0:6686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788845837.987216:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788845837.987218:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788845837.987219:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845837.987221:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788845837.987222:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845837.987223:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845837.987225:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788845837.987226:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788845837.987227:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788845837.987229:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845837.987230:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788845837.987243:0:6686:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788845837.993698:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788845837.995011:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788845837.995275:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788845837.995509:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788845837.995781:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788845837.995988:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788845837.996267:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788845837.997500:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788845838.294316:0:6686:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788845838.294323:0:6686:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788845838.294352:0:6686:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788845838.294430:0:6686:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788845838.294444:0:6686:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788845838.294467:0:6686:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788845839.014326:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845840.038455:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845841.063762:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845842.086505:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845843.113398:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788845843.366695:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788845843.366704:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788845843.366707:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a0b04977800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788845843.366718:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a0b04977800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1788845843.366750:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3da24700 x1875740738988672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788845843.366892:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740738988288:0@lo:400: 00000100:00100000:0.0:1788845843.366960:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845843.367007:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845843.367013:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740738988416:0@lo:400: 00000100:00100000:0.0:1788845843.367043:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845843.367070:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845843.367078:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740738988544:0@lo:400: 00000100:00100000:0.0:1788845843.367104:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845843.367169:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740738988672:0@lo:8: 00000100:00100000:0.0:1788845843.367193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845843.367240:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738988288 00000100:00100000:0.0:1788845843.367246:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738988288 00000100:00100000:0.0:1788845843.367287:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788845843.367295:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:3307:x1875740738988288:12345-0@lo:400: 00000100:00100000:0.0:1788845843.367341:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:3307:x1875740738988288:12345-0@lo:400: Request processed in 46us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845843.367347:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788845843.367383:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738988416 00000100:00100000:0.0:1788845843.367387:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738988416 00000100:00100000:0.0:1788845843.367410:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738988544 00000100:00100000:0.0:1788845843.367413:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738988544 00000100:00100000:0.0:1788845843.367436:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788845843.367442:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740738988416:12345-0@lo:400: 00000100:00100000:0.0:1788845843.367474:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740738988416:12345-0@lo:400: Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845843.367480:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788845843.367492:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788845843.367498:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740738988544:12345-0@lo:400: 00000100:00100000:0.0:1788845843.367531:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740738988544:12345-0@lo:400: Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845843.367537:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788845843.367578:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3da24000 x1875740738988544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845843.367592:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740738988544:0@lo:400: 00010000:00080000:0.0:1788845843.367620:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3da27480 x1875740738988416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845843.367628:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740738988416:0@lo:400: 00000100:00100000:0.0:1788845843.367663:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740738988288:0@lo:400: 00000100:00100000:0.0:1788845843.367711:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738988672 00000100:00100000:0.0:1788845843.367716:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738988672 00000100:00100000:0.0:1788845843.367754:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845843.367758:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1875740738988672:12345-0@lo:8: 00010000:00080000:0.0:1788845843.367782:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:0.0:1788845843.367806:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1345bc80c773edbd 00002000:00100000:0.0:1788845843.367845:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a0c3d8b2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788845843.367850:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788845843.367854:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788845843.367964:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788845843.368098:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788845843.368122:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d8b5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788845843.368185:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875740738988672:12345-0@lo:8: Request processed in 425us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845843.368192:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788845843.368226:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3da24700 x1875740738988672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788845853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788845843.368237:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788845843.368243:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788845843.368247:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788845843.368249:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0b04977800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788845843.368262:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788845843.368267:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740738988672:0@lo:8: 00000004:00080000:0.0:1788845843.368287:0:6716:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788845843.368647:0:6716:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 175585493212ns, next at 0ns, rc = 0 00000100:00080000:0.0:1788845843.368704:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788845843.479198:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000001:00100000:3.0:1788845843.497038:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:3.0:1788845843.567385:0:6717:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788845843.567412:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875740738988928:0@lo:7: 00000100:00100000:3.0:1788845843.567475:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845843.567518:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074f2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845843.567546:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740738988800:0@lo:13: 00000100:00100000:3.0:1788845843.567691:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845843.567760:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738988928 00000100:00100000:3.0:1788845843.567767:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738988928 00000100:00100000:3.0:1788845843.567814:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845843.567823:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6717:x1875740738988928:12345-0@lo:7: 00000100:00080000:2.0:1788845843.569208:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845843.569231:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738988800 00000100:00100000:2.0:1788845843.569239:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738988800 00000100:00100000:2.0:1788845843.569288:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845843.569297:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875740738988800:12345-0@lo:13: 00002000:00000024:2.0:1788845843.569321:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788845843.569385:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875740738988800:12345-0@lo:13: Request processed in 90us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845843.569392:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788845843.581671:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d9edf80 x1875740738988800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845843.581700:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740738988800:0@lo:13: 00002000:00080000:3.0:1788845843.586251:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788845843.586265:0:6689:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788845843.586366:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6717:x1875740738988928:12345-0@lo:7: Request processed in 18541us (18887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845843.586376:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788845843.586455:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d9edc00 x1875740738988928/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788845859 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845843.586468:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875740738988928:0@lo:7: 00000004:00080000:3.0:1788845843.586480:0:6717:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788845843.586511:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875740738989056:0@lo:5: 00000100:00100000:3.0:1788845843.586539:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845843.586586:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074f2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845843.586801:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738989056 00000100:00100000:1.0:1788845843.586807:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738989056 00000100:00100000:1.0:1788845843.586841:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845843.586848:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6717:x1875740738989056:12345-0@lo:5: 00002000:00080000:1.0:1788845843.586870:0:6688:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788845843.586873:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788845843.587201:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6717:x1875740738989056:12345-0@lo:5: Request processed in 352us (660us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788845843.587208:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788845843.590126:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d9edc00 x1875740738989056/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845859 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845843.590148:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875740738989056:0@lo:5: 00000004:00080000:3.0:1788845843.590191:0:6717:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788845843.590250:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875740738989184:0@lo:700: 00000100:00100000:3.0:1788845843.590447:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845843.590490:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074f2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845843.590562:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738989184 00000100:00100000:1.0:1788845843.590569:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738989184 00000100:00100000:1.0:1788845843.590622:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845843.590631:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:6717:x1875740738989184:12345-0@lo:700: 00000100:00100000:1.0:1788845843.590665:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1875740738989312:0@lo:700: 00000100:00100000:1.0:1788845843.590699:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845843.590717:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074533c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845843.590749:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738989312 00000100:00100000:1.0:1788845843.590753:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738989312 00000100:00100000:1.0:1788845843.590777:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845843.590784:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1875740738989312:12345-0@lo:700: 40000000:02000000:0.0:1788845843.639025:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788845843.650425:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1875740738989312:12345-0@lo:700: Request processed in 59634us (59718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845843.650442:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788845843.656381:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c206d0e00 x1875740738989312/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788845859 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845843.656398:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1875740738989312:0@lo:700: 40000000:02000000:1.0:1788845843.656410:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1788845843.839181:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1788845843.840339:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6717:x1875740738989184:12345-0@lo:700: Request processed in 249703us (249887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845843.840357:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788845843.840802:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d9ef100 x1875740738989184/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788845859 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845843.840812:0:6717:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788845843.840830:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875740738989184:0@lo:700: 10000000:01000000:1.0:1788845843.878386:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788845843.878398:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a0c0942a000 from 4 10000000:01000000:1.0:1788845843.878403:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788845843.878443:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845843.878456:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845843.878467:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845843.878490:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738989440:0@lo:101: 00000100:00100000:1.0:1788845843.878565:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845843.879035:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738989440 00000100:00100000:1.0:1788845843.879043:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738989440 00000100:00100000:1.0:1788845843.879083:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788845843.879091:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740738989440:12345-0@lo:101: 00010000:00010000:1.0:1788845843.879104:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845843.879116:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773edcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773edc4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845843.879140:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773edcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773edc4 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845843.879173:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773edcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773edc4 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845843.879183:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474a00, rc 0) 00000100:00100000:1.0:1788845843.879223:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738989440:12345-0@lo:101: Request processed in 131us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845843.879238:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788845843.879295:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c07453c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845843.879315:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738989440:0@lo:101: 00010000:00010000:1.0:1788845843.879329:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773edcb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845843.879338:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773edcb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845843.879390:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738989568:0@lo:256: 00000100:00100000:1.0:1788845843.879439:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845843.879452:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c07453c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845843.879822:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738989568 00000100:00100000:0.0:1788845843.879828:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738989568 00000100:00100000:0.0:1788845843.879883:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788845843.879891:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738989568:12345-0@lo:256: 20000000:01000000:0.0:1788845843.879904:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788845843.879932:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788845843.879936:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788845843.880027:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738989568:12345-0@lo:256: Request processed in 136us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845843.880033:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788845843.880089:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738989568:0@lo:256: 10000000:01000000:0.0:1788845843.880144:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788845843.880167:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773edcb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845843.880177:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773edcb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:02000040:2.0:1788845843.938991:0:6717:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788845843.967421:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875740738989696:0@lo:5: 00000100:00100000:3.0:1788845843.967484:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845843.967540:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074f2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845843.969763:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738989696 00000100:00100000:2.0:1788845843.969777:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738989696 00000100:00100000:2.0:1788845843.969841:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788845843.969852:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6717:x1875740738989696:12345-0@lo:5: 00002000:00080000:2.0:1788845843.985894:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788845843.985912:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788845843.995900:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6717:x1875740738989696:12345-0@lo:5: Request processed in 26044us (28410us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788845843.995911:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788845843.996413:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d9ef100 x1875740738989696/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845859 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845843.996432:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1875740738989696:0@lo:5: 00000004:00080000:3.0:1788845843.996445:0:6717:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788845844.138515:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845845.170956:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845846.195955:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788845846.658362:0:7061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788845847.210643:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845848.234794:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845848.488941:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740738989824:0@lo:400: 00000100:00100000:3.0:1788845848.488960:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740738990080:0@lo:400: 00000100:00100000:3.0:1788845848.489017:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845848.489057:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845848.489149:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740738989952:0@lo:400: 00000100:00100000:2.0:1788845848.489204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845848.489279:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738989824 00000100:00100000:1.0:1788845848.489286:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738989824 00000100:00100000:1.0:1788845848.489336:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788845848.489345:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:3307:x1875740738989824:12345-0@lo:400: 00000100:00100000:1.0:1788845848.489396:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:3307:x1875740738989824:12345-0@lo:400: Request processed in 52us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845848.489403:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788845848.489641:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845848.489650:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740738990208:0@lo:400: 00000100:00100000:3.0:1788845848.489683:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845848.489762:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738990080 00000100:00100000:3.0:1788845848.489763:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738989952 00000100:00100000:3.0:1788845848.489771:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738989952 00000100:00100000:0.0:1788845848.489771:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738990080 00000100:00100000:0.0:1788845848.489815:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788845848.489944:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845848.490020:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788845848.490029:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788845848.490047:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738990208 00000100:00100000:3.0:1788845848.490051:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738990208 00000100:00100000:3.0:1788845848.490094:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845848.490113:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875740738990208:12345-0@lo:400: 00000100:00100000:3.0:1788845848.490173:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875740738990208:12345-0@lo:400: Request processed in 72us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845848.490180:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788845848.490246:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d9ee680 x1875740738990208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845848.490259:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740738990208:0@lo:400: 00000100:00100000:3.0:1788845848.490357:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740738989824:0@lo:400: 00000100:00100000:3.0:1788845848.490390:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845848.490398:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740738989952:12345-0@lo:400: 00000100:00100000:3.0:1788845848.490432:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740738989952:12345-0@lo:400: Request processed in 35us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845848.490438:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788845848.490464:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d9ec000 x1875740738989952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845848.490473:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740738989952:0@lo:400: 00000100:00100000:0.0:1788845848.494488:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740738990080:12345-0@lo:400: 00000100:00100000:0.0:1788845848.494770:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740738990080:12345-0@lo:400: Request processed in 4946us (5751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845848.494781:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788845848.494853:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d9ec700 x1875740738990080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845848.494867:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740738990080:0@lo:400: 00000100:00080000:2.0:1788845848.501960:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845848.999449:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845848.999475:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740738990336:0@lo:13: 00000100:00100000:3.0:1788845848.999537:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845848.999653:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738990336 00000100:00100000:3.0:1788845848.999660:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738990336 00000100:00100000:3.0:1788845848.999716:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845848.999726:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875740738990336:12345-0@lo:13: 00002000:00000024:3.0:1788845848.999758:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845848.999814:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875740738990336:12345-0@lo:13: Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845848.999822:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788845848.999864:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c206d2680 x1875740738990336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845848.999884:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740738990336:0@lo:13: 00000001:00080000:3.0:1788845849.131945:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788845849.254420:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845850.278413:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845851.305103:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845852.327956:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845853.358149:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845853.606458:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740738990848:0@lo:400: 00000100:00100000:0.0:1788845853.606463:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740738990592:0@lo:400: 00000100:00100000:3.0:1788845853.606527:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740738990464:0@lo:400: 00000100:00100000:1.0:1788845853.607958:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845853.608008:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738990592 00000100:00100000:0.0:1788845853.608017:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738990592 00000100:00100000:1.0:1788845853.608031:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845853.608040:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740738990720:0@lo:400: 00000100:00100000:0.0:1788845853.608060:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845853.608067:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740738990592:12345-0@lo:400: 00000100:00100000:1.0:1788845853.608081:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845853.608376:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740738990592:12345-0@lo:400: Request processed in 45us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845853.608384:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845853.608401:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738990720 00000100:00100000:0.0:1788845853.608405:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738990720 00000100:00100000:0.0:1788845853.608436:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788845853.608441:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740738990720:12345-0@lo:400: 00000100:00100000:0.0:1788845853.608486:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740738990720:12345-0@lo:400: Request processed in 45us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845853.608492:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788845853.608608:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c206d1500 x1875740738990592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845853.608622:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740738990592:0@lo:400: 00010000:00080000:1.0:1788845853.608648:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c206d1f80 x1875740738990720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845853.608657:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740738990720:0@lo:400: 00000100:00080000:1.0:1788845853.608721:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845853.609002:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845853.609015:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845853.609418:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738990848 00000100:00100000:0.0:1788845853.609423:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738990848 00000100:00100000:0.0:1788845853.609484:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845853.609491:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740738990848:12345-0@lo:400: 00000100:00100000:0.0:1788845853.609537:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740738990848:12345-0@lo:400: Request processed in 46us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845853.609555:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788845853.609615:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788845853.609641:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c206d2680 x1875740738990848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845853.609651:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788845853.609664:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740738990848:0@lo:400: 00000100:00100000:1.0:1788845853.611444:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738990464 00000100:00100000:1.0:1788845853.611456:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738990464 00000100:00100000:1.0:1788845853.611506:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788845853.611514:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:3308:x1875740738990464:12345-0@lo:400: 00000100:00100000:1.0:1788845853.611621:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:3308:x1875740738990464:12345-0@lo:400: Request processed in 107us (2605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845853.611629:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788845853.611985:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740738990464:0@lo:400: 00000100:00100000:2.0:1788845854.118355:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740738990976:0@lo:13: 00000100:00100000:2.0:1788845854.118566:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845854.118871:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738990976 00000100:00100000:3.0:1788845854.118879:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738990976 00000100:00100000:3.0:1788845854.118923:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845854.118933:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740738990976:12345-0@lo:13: 00002000:00000024:3.0:1788845854.118967:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845854.120132:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740738990976:12345-0@lo:13: Request processed in 1195us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845854.120142:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788845854.120841:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d9ef480 x1875740738990976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845854.120879:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740738990976:0@lo:13: 00010000:00010000:3.0:1788845854.374616:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845855.412512:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845856.427876:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845857.447606:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788845858.004872:0:7630:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788845858.004876:0:7630:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788845858.004972:0:7630:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a0c2067c000 00000020:01000004:0.0:1788845858.004985:0:7630:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788845858.004996:0:7630:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788845858.005009:0:7630:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a0c347a4d28) 00000020:00000080:0.0:1788845858.005023:0:7630:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788845858.024094:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788845858.024577:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788845858.044864:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788845858.051424:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788845858.051459:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788845858.051517:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788845858.051542:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788845858.053351:0:7630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788845858.053365:0:7630:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788845858.053377:0:7630:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1345bc80c773edd9 00000020:01000004:2.0:1788845858.053385:0:7630:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788845858.053405:0:7630:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788845858.053408:0:7630:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788845858.053414:0:7630:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788845858.053434:0:7630:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788845858.053438:0:7630:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788845858.078340:0:7630:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788845858.078374:0:7630:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.148@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788845858.078378:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788845858.078379:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788845858.078381:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845858.078382:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845858.078383:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845858.078384:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845858.078389:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845858.078390:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788845858.078392:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788845858.078393:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845858.078395:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788845858.078398:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788845858.078400:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788845858.078401:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788845858.078402:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845858.078403:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845858.078404:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845858.078405:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845858.078406:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845858.078407:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788845858.078407:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788845858.078408:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845858.078409:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788845858.078442:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788845858.078458:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738991104:0@lo:253: 00000100:00100000:3.0:1788845858.078521:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845858.078574:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845858.078875:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738991104 00000100:00100000:2.0:1788845858.078882:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738991104 00000100:00100000:2.0:1788845858.078931:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788845858.078940:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:7630:x1875740738991104:12345-0@lo:253: 20000000:01000000:2.0:1788845858.078974:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788845858.078977:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788845858.078981:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788845858.078984:0:5840:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788845858.081684:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845858.081904:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788845858.081919:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788845858.081960:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788845858.081968:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788845858.081999:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788845858.082073:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788845858.082614:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788845858.082633:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:3.0:1788845858.082635:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:3.0:1788845858.082683:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788845858.082692:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788845858.082742:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788845858.082752:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:3.0:1788845858.082796:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788845858.082804:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788845858.082833:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788845858.082882:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788845858.085849:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788845858.085875:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:3.0:1788845858.085878:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:3.0:1788845858.085913:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788845858.085921:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788845858.085949:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788845858.085956:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:3.0:1788845858.085984:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788845858.085993:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788845858.086036:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788845858.086091:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788845858.086111:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788845858.086113:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788845858.086117:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788845858.086127:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788845858.086130:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788845858.086618:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788845858.086622:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788845858.087999:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788845858.088443:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788845858.088492:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788845858.088828:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788845858.088871:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788845858.089089:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788845858.089105:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788845858.089107:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788845858.093107:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788845858.093617:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788845858.093680:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788845858.093756:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788845858.093770:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788845858.093772:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788845858.096834:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788845858.097013:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788845858.097077:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788845858.097482:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788845858.097525:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788845858.097585:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788845858.097599:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788845858.097601:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788845858.102700:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788845858.102796:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788845858.102855:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788845858.103568:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788845858.103614:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788845858.103645:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788845858.103675:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788845858.103678:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788845858.103688:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788845858.103707:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.103725:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773ed23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed1c expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.103749:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c00030e00/0x1345bc80c773ed3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed38 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.103756:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c00030c00/0x1345bc80c773ed5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed54 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.103761:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773ed69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed62 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.103768:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c01475800/0x1345bc80c773edaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773eda8 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.103775:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.103811:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c01475800/0x1345bc80c773edaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773eda8 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.103824:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c01475800/0x1345bc80c773edaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773eda8 expref: 16 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845858.103838:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da24700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738991232:0@lo:104: 00000100:00100000:0.0:1788845858.103899:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788845858.103947:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773ed69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ed62 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.103956:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773ed69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ed62 expref: 16 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845858.103965:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738991360:0@lo:104: 00010000:00010000:0.0:1788845858.104003:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c00030c00/0x1345bc80c773ed5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ed54 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.104011:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c00030c00/0x1345bc80c773ed5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ed54 expref: 16 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845858.104019:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da27480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738991488:0@lo:104: 00010000:00010000:0.0:1788845858.104044:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c00030e00/0x1345bc80c773ed3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ed38 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.104051:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c00030e00/0x1345bc80c773ed3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ed38 expref: 16 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845858.104118:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da24000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738991616:0@lo:104: 00010000:00010000:0.0:1788845858.104141:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773ed23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ed1c expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.104149:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773ed23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ed1c expref: 16 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845858.104405:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788845858.104422:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845858.104441:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845858.104448:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845858.104465:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738991232 00000100:00100000:1.0:1788845858.104471:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738991232 00000100:00100000:1.0:1788845858.104499:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738991360 00000100:00100000:1.0:1788845858.104501:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738991360 00000100:00100000:1.0:1788845858.104508:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738991488 00000100:00100000:1.0:1788845858.104510:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738991488 00000100:00100000:1.0:1788845858.104517:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738991616 00000100:00100000:1.0:1788845858.104518:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738991616 00000100:00100000:1.0:1788845858.104529:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845858.104536:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c17cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+6:5840:x1875740738991232:12345-0@lo:104: 00010000:00010000:1.0:1788845858.104547:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773edaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.104589:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788845858.104594:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c17cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+6:5840:x1875740738991232:12345-0@lo:104: Request processed in 59us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.104600:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845858.104630:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788845858.104635:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:5840:x1875740738991360:12345-0@lo:104: 00010000:00010000:1.0:1788845858.104642:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ed69 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.104683:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788845858.104688:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:5840:x1875740738991360:12345-0@lo:104: Request processed in 53us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.104694:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788845858.104705:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788845858.104710:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+4:5840:x1875740738991488:12345-0@lo:104: 00010000:00010000:1.0:1788845858.104716:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c00031600/0x1345bc80c773ed54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ed5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.104752:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788845858.104757:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+4:5840:x1875740738991488:12345-0@lo:104: Request processed in 47us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.104762:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788845858.104772:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788845858.104777:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:5840:x1875740738991616:12345-0@lo:104: 00010000:00010000:1.0:1788845858.104783:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c02824600/0x1345bc80c773ed38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ed3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.104806:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788845858.104810:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:5840:x1875740738991616:12345-0@lo:104: Request processed in 33us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.104814:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845858.104891:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da24a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738991744:0@lo:104: 00000100:00100000:0.0:1788845858.104914:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845858.104937:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074aa540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845858.104955:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da24700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738991232:0@lo:104: 00000100:00100000:0.0:1788845858.104962:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738991360:0@lo:104: 00000100:00100000:0.0:1788845858.104968:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da27480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738991488:0@lo:104: 00000100:00100000:0.0:1788845858.104974:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da24000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738991616:0@lo:104: 00010000:00010000:2.0:1788845858.105043:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788845858.105050:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773edaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105099:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031200 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788845858.105103:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773edaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105111:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773edaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845858.105117:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773edaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845858.105123:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845858.105180:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773edaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105186:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845858.105214:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773edaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105221:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c00031200/0x1345bc80c773eda8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773edaf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105242:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788845858.105246:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ed69 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105252:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f56800 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788845858.105255:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ed69 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105272:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ed69 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845858.105279:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ed69 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845858.105284:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845858.105297:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed69 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105302:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845858.105307:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed69 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105313:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56800/0x1345bc80c773ed62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed69 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105322:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788845858.105325:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c00031600/0x1345bc80c773ed54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ed5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105330:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031600 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788845858.105341:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c00031600/0x1345bc80c773ed54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ed5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105348:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c00031600/0x1345bc80c773ed54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ed5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845858.105354:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c00031600/0x1345bc80c773ed54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ed5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845858.105365:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845858.105379:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c00031600/0x1345bc80c773ed54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105384:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845858.105398:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c00031600/0x1345bc80c773ed54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105404:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c00031600/0x1345bc80c773ed54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105412:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845858.105415:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c02824600/0x1345bc80c773ed38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ed3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105420:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824600 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788845858.105422:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02824600/0x1345bc80c773ed38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ed3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105428:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c02824600/0x1345bc80c773ed38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ed3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845858.105433:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02824600/0x1345bc80c773ed38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ed3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845858.105437:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845858.105460:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c02824600/0x1345bc80c773ed38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105466:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845858.105478:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c02824600/0x1345bc80c773ed38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105483:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c02824600/0x1345bc80c773ed38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.105491:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845858.105493:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845858.105496:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845858.105508:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740738992256:0@lo:103: 00000100:00100000:2.0:1788845858.105541:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845858.105562:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845858.105567:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740738992128:0@lo:103: 00000100:00100000:2.0:1788845858.105587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845858.105741:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738991744 00000100:00100000:3.0:1788845858.105754:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738991744 00000100:00100000:3.0:1788845858.105780:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788845858.105787:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:5840:x1875740738991744:12345-0@lo:104: 00010000:00010000:3.0:1788845858.105795:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c773ed1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ed23 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.105852:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788845858.105858:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:5840:x1875740738991744:12345-0@lo:104: Request processed in 72us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845858.105864:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788845858.105885:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738992256 00000100:00100000:3.0:1788845858.105888:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738992256 00010000:00010000:3.0:1788845858.105904:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c00030e00/0x1345bc80c773ed3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ed38 expref: 17 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845858.105922:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738992128 00000100:00100000:3.0:1788845858.105924:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738992128 00010000:00010000:3.0:1788845858.105933:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c00030c00/0x1345bc80c773ed5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ed54 expref: 18 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845858.105949:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788845858.105953:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:3308:x1875740738992256:12345-0@lo:103: 00010000:00010000:3.0:1788845858.105963:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845858.105967:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c00030e00/0x1345bc80c773ed3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ed38 expref: 18 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.105976:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c00030e00/0x1345bc80c773ed3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ed38 expref: 18 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.105989:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c00030e00/0x1345bc80c773ed3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ed38 expref: 18 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.106008:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845858.106049:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:3308:x1875740738992256:12345-0@lo:103: Request processed in 96us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845858.106055:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788845858.106068:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788845858.106074:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:3308:x1875740738992128:12345-0@lo:103: 00010000:00010000:3.0:1788845858.106081:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845858.106085:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c00030c00/0x1345bc80c773ed5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ed54 expref: 16 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.106092:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c00030c00/0x1345bc80c773ed5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ed54 expref: 16 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.106102:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c00030c00/0x1345bc80c773ed5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ed54 expref: 16 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.106112:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845858.106134:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:3308:x1875740738992128:12345-0@lo:103: Request processed in 61us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845858.106140:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788845858.106220:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740738992128:0@lo:103: 00000100:00100000:3.0:1788845858.106241:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740738992256:0@lo:103: 00010000:00010000:3.0:1788845858.106265:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845858.106269:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c773ed1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ed23 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.106276:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475e00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:3.0:1788845858.106285:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c773ed1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ed23 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.106293:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c773ed1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ed23 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845858.106299:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c773ed1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ed23 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845858.106304:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845858.106321:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c773ed1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed23 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.106327:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845858.106331:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c773ed1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed23 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.106336:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c773ed1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed23 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.106347:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845858.106349:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845858.106350:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845858.106813:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da24a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875740738991744:0@lo:104: 00010000:00010000:2.0:1788845858.106840:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845858.108920:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738991872:0@lo:103: 00000100:00100000:0.0:1788845858.108986:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845858.109035:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738992384:0@lo:103: 00000100:00100000:0.0:1788845858.109054:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845858.109080:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845858.109086:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738992000:0@lo:103: 00000100:00100000:0.0:1788845858.109106:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788845858.109134:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845858.109140:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845858.109172:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738991872 00000100:00100000:0.0:1788845858.109180:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738991872 00010000:00010000:0.0:1788845858.109219:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c01475800/0x1345bc80c773edaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773eda8 expref: 15 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845858.109250:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738992384 00000100:00100000:0.0:1788845858.109253:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738992384 00010000:00010000:0.0:1788845858.109264:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773ed23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ed1c expref: 16 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845858.109272:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738992000 00000100:00100000:0.0:1788845858.109274:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738992000 00010000:00010000:0.0:1788845858.109282:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773ed69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ed62 expref: 17 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845858.109293:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845858.109301:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:3309:x1875740738991872:12345-0@lo:103: 00010000:00010000:0.0:1788845858.109313:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845858.109318:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c01475800/0x1345bc80c773edaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773eda8 expref: 17 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109328:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c01475800/0x1345bc80c773edaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773eda8 expref: 17 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109352:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01475800/0x1345bc80c773edaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773eda8 expref: 17 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109367:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845858.109400:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:3309:x1875740738991872:12345-0@lo:103: Request processed in 100us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845858.109407:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845858.109422:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845858.109428:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:3309:x1875740738992384:12345-0@lo:103: 00010000:00010000:0.0:1788845858.109435:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845858.109439:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773ed23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ed1c expref: 15 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109447:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773ed23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ed1c expref: 15 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109456:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773ed23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ed1c expref: 15 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109465:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845858.109485:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:3309:x1875740738992384:12345-0@lo:103: Request processed in 58us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845858.109491:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845858.109502:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845858.109508:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:3309:x1875740738992000:12345-0@lo:103: 00010000:00010000:0.0:1788845858.109514:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845858.109517:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773ed69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ed62 expref: 13 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109531:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773ed69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ed62 expref: 13 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109541:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773ed69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ed62 expref: 13 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109552:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109559:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109572:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109578:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109584:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109589:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109595:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788845858.109598:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109605:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109631:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109641:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845858.109675:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:3309:x1875740738992000:12345-0@lo:103: Request processed in 167us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845858.109681:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845858.109717:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738992000:0@lo:103: 00000100:00100000:0.0:1788845858.109727:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738991872:0@lo:103: 00000100:00100000:0.0:1788845858.109734:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740738992384:0@lo:103: 00010000:00010000:0.0:1788845858.109766:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109774:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.109780:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ede0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788845858.109792:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788845858.177907:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:7630:x1875740738991104:12345-0@lo:253: Request processed in 98961us (99378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845858.177921:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788845858.178353:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738991104:0@lo:253: 10000000:01000000:1.0:1788845858.178368:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788845858.178371:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788845858.178372:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788845858.178374:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845858.178375:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788845858.178376:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845858.178377:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845858.178379:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788845858.178380:0:7630:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788845858.178382:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845858.178458:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788845858.178480:0:7630:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a0c2067c000 from lustre-OST0001 10000000:01000000:1.0:1788845858.178506:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788845858.178508:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788845858.178515:0:7630:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a0c088c4d28 local copy 10000000:01000000:1.0:1788845858.178532:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788845858.178566:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.178577:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.178587:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845858.178605:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738992512:0@lo:101: 00000100:00100000:1.0:1788845858.178645:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845858.178884:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738992512 00000100:00100000:0.0:1788845858.178891:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738992512 00000100:00100000:0.0:1788845858.178935:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788845858.178944:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+11:7630:x1875740738992512:12345-0@lo:101: 00010000:00010000:0.0:1788845858.178956:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845858.178967:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c00030400/0x1345bc80c773edee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ede7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.179001:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c00030400/0x1345bc80c773edee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ede7 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.179012:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c00030400/0x1345bc80c773edee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ede7 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.179037:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030400, rc 0) 00000100:00100000:0.0:1788845858.179067:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:7630:x1875740738992512:12345-0@lo:101: Request processed in 124us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845858.179073:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788845858.179355:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b18180 going to sleep for 11 seconds 00000100:00100000:1.0:1788845858.179374:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738992512:0@lo:101: 00010000:00010000:1.0:1788845858.179461:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1345bc80c773edee expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.179470:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1345bc80c773edee expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845858.179567:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738992640:0@lo:501: 00000100:00100000:1.0:1788845858.179596:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845858.179674:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738992640 00000100:00100000:2.0:1788845858.179679:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738992640 00000100:00100000:2.0:1788845858.179715:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788845858.179722:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:7630:x1875740738992640:12345-0@lo:501: 00000100:00100000:2.0:1788845858.179918:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:7630:x1875740738992640:12345-0@lo:501: Request processed in 196us (320us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788845858.179925:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788845858.183548:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b18180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845858.183683:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738992640:0@lo:501: 10000000:01000000:0.0:1788845858.183708:0:7630:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788845858.183765:0:7630:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788845858.183774:0:7630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1345bc80c773edee expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.183786:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1345bc80c773edee expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.183793:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1345bc80c773edee expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.183818:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788845858.183843:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a0c2067c000 10000000:01000000:0.0:1788845858.183849:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788845858.183854:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788845858.183857:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788845858.183876:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788845858.183879:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788845858.183910:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.183918:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.183929:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845858.183947:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738992768:0@lo:101: 00000100:00100000:0.0:1788845858.184006:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845858.184050:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3c973840 going to sleep for 11 seconds 00010000:00010000:3.0:1788845858.184217:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845858.184224:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1345bc80c773edee expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.184232:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475200 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:3.0:1788845858.184242:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1345bc80c773edee expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.184250:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1345bc80c773edee expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845858.184256:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1345bc80c773edee expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845858.184261:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845858.184280:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1345bc80c773edee expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.184286:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845858.184313:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1345bc80c773edee expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.184320:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ede7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1345bc80c773edee expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.184333:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845858.184334:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845858.184336:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845858.184494:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740738992896:0@lo:103: 00000100:00100000:1.0:1788845858.184534:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845858.184628:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738992768 00000100:00100000:2.0:1788845858.184635:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738992768 00000100:00100000:2.0:1788845858.184691:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788845858.184700:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:7630:x1875740738992768:12345-0@lo:101: 00010000:00010000:2.0:1788845858.184720:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845858.184732:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c02824600/0x1345bc80c773edfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773edf5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.184754:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02824600/0x1345bc80c773edfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773edf5 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.184764:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c02824600/0x1345bc80c773edfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773edf5 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.184771:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02824600, rc 0) 00000100:00100000:2.0:1788845858.184807:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:7630:x1875740738992768:12345-0@lo:101: Request processed in 108us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845858.184813:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788845858.184975:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738992896 00000100:00100000:3.0:1788845858.184979:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738992896 00000100:00100000:3.0:1788845858.185027:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845858.185035:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:3310:x1875740738992896:12345-0@lo:103: 00010000:00010000:3.0:1788845858.185045:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845858.185058:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c00030400/0x1345bc80c773edee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773ede7 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.185078:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845858.185122:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:3310:x1875740738992896:12345-0@lo:103: Request processed in 87us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845858.185128:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788845858.185411:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740738992896:0@lo:103: 00000100:00100000:0.0:1788845858.185546:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738992768:0@lo:101: 00010000:00010000:0.0:1788845858.185561:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773edfc expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.185570:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773edfc expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845858.185729:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993024:0@lo:501: 00000100:00100000:0.0:1788845858.185763:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845858.185794:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3c973840 going to sleep for 11 seconds 00000100:00100000:3.0:1788845858.185843:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738993024 00000100:00100000:3.0:1788845858.185848:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738993024 00000100:00100000:3.0:1788845858.185877:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788845858.185884:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:7630:x1875740738993024:12345-0@lo:501: 00000100:00100000:3.0:1788845858.186115:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:7630:x1875740738993024:12345-0@lo:501: Request processed in 230us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845858.186121:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788845858.186327:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993024:0@lo:501: 00000100:00100000:0.0:1788845858.186354:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993152:0@lo:503: 00000100:00100000:0.0:1788845858.186466:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845858.186493:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3c973840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845858.186562:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738993152 00000100:00100000:1.0:1788845858.186567:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738993152 00000100:00100000:1.0:1788845858.186600:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788845858.186608:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:7630:x1875740738993152:12345-0@lo:503: 00000100:00100000:1.0:1788845858.186783:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:7630:x1875740738993152:12345-0@lo:503: Request processed in 175us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.186789:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788845858.186939:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993152:0@lo:503: 00000040:00080000:0.0:1788845858.187360:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788845858.187489:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993280:0@lo:502: 00000100:00100000:0.0:1788845858.187533:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845858.187547:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3c973840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845858.187614:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738993280 00000100:00100000:1.0:1788845858.187619:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738993280 00000100:00100000:1.0:1788845858.187639:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788845858.187645:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:7630:x1875740738993280:12345-0@lo:502: 00000100:00100000:1.0:1788845858.187790:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:7630:x1875740738993280:12345-0@lo:502: Request processed in 144us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.187796:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788845858.187990:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993280:0@lo:502: 00000040:00080000:0.0:1788845858.188499:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788845858.188545:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788845858.188572:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788845858.188620:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788845858.188789:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788845858.188829:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788845858.188859:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993408:0@lo:502: 00000100:00100000:0.0:1788845858.188907:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845858.188932:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3c973840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845858.188997:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738993408 00000100:00100000:1.0:1788845858.189003:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738993408 00000100:00100000:1.0:1788845858.189047:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788845858.189054:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:7630:x1875740738993408:12345-0@lo:502: 00000100:00100000:1.0:1788845858.189588:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:7630:x1875740738993408:12345-0@lo:502: Request processed in 532us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.189596:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788845858.190483:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993408:0@lo:502: 00000040:00080000:2.0:1788845858.190606:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788845858.190619:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788845858.193540:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788845858.193551:0:7636:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788845858.193557:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845858.193559:0:7636:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788845858.193565:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788845858.193579:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a0c3eadb370) 00000020:00000080:1.0:1788845858.193600:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788845858.193606:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788845858.193679:0:7636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a0c2067c000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788845858.193687:0:7636:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788845858.193694:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1345bc80c773ee0a 00010000:00010000:0.0:1788845858.202964:0:7636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788845858.203461:0:7636:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788845858.208889:0:7636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788845858.209539:0:7636:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788845858.219519:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788845858.235171:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788845858.240618:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788845858.240630:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845858.240637:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845858.240639:0:7636:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788845858.240643:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845858.240648:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845858.241334:0:7636:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788845858.241342:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788845858.241344:0:7636:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788845858.241469:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845858.241474:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845858.241476:0:7636:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788845858.241479:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788845858.246755:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788845858.246798:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788845858.246823:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773edfc expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.246852:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773edfc expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845858.246862:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c2067c000 from 1 10000000:01000000:2.0:1788845858.246865:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788845858.246906:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.246914:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.246924:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845858.246948:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993536:0@lo:101: 00000100:00100000:2.0:1788845858.247005:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845858.247057:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c34e77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845858.247201:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738993536 00000100:00100000:0.0:1788845858.247209:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738993536 00000100:00100000:0.0:1788845858.247258:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788845858.247267:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:7630:x1875740738993536:12345-0@lo:101: 00010000:00010000:0.0:1788845858.247281:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845858.247294:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ee18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ee11 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.247791:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ee18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ee11 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.247803:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ee18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ee11 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.247812:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030400, rc 0) 00000100:00100000:0.0:1788845858.247856:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:7630:x1875740738993536:12345-0@lo:101: Request processed in 590us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845858.247864:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788845858.249464:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993536:0@lo:101: 00010000:00010000:2.0:1788845858.249485:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee18 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.249499:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ee18 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845858.249604:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993664:0@lo:501: 00000100:00100000:2.0:1788845858.249666:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845858.249691:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c34e77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845858.252993:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738993664 00000100:00100000:1.0:1788845858.253007:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738993664 00000100:00100000:1.0:1788845858.253075:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788845858.253084:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:7630:x1875740738993664:12345-0@lo:501: 00000100:00100000:1.0:1788845858.253405:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:7630:x1875740738993664:12345-0@lo:501: Request processed in 321us (3752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.253413:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788845858.253903:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993664:0@lo:501: 00000100:00100000:2.0:1788845858.253946:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993792:0@lo:503: 00000100:00100000:2.0:1788845858.253988:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845858.254016:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c34e77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845858.254059:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738993792 00000100:00100000:1.0:1788845858.254063:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738993792 00000100:00100000:1.0:1788845858.254096:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788845858.254104:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:7630:x1875740738993792:12345-0@lo:503: 00000100:00100000:1.0:1788845858.254575:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:7630:x1875740738993792:12345-0@lo:503: Request processed in 470us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.254583:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788845858.254665:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993792:0@lo:503: 00000040:00080000:2.0:1788845858.254922:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788845858.254985:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993920:0@lo:502: 00000100:00100000:2.0:1788845858.255022:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845858.255045:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c34e77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845858.255179:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738993920 00000100:00100000:1.0:1788845858.255185:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738993920 00000100:00100000:1.0:1788845858.255224:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788845858.255231:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:7630:x1875740738993920:12345-0@lo:502: 00000100:00100000:1.0:1788845858.255511:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:7630:x1875740738993920:12345-0@lo:502: Request processed in 278us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.255518:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788845858.255613:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738993920:0@lo:502: 00000040:00080000:2.0:1788845858.256499:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788845858.256558:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788845858.256592:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738994048:0@lo:502: 00000100:00100000:2.0:1788845858.256641:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845858.256827:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c34e77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845858.262328:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738994048 00000100:00100000:1.0:1788845858.262343:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738994048 00000100:00100000:1.0:1788845858.262411:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788845858.262421:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:7630:x1875740738994048:12345-0@lo:502: 00000100:00100000:1.0:1788845858.262671:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:7630:x1875740738994048:12345-0@lo:502: Request processed in 251us (6029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.262690:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788845858.262707:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738994048:0@lo:502: 00000040:00080000:2.0:1788845858.262844:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788845858.262858:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788845858.263349:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845858.263357:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845858.263360:0:7640:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788845858.263366:0:7640:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a0c2067c000 00000020:00000080:0.0:1788845858.263369:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788845858.263387:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845858.263390:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845858.263392:0:7640:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788845858.263395:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788845858.263615:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788845858.263634:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845858.263664:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee18 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.263676:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee18 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845858.263720:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788845858.263723:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a0c2067c000 10000000:01000000:2.0:1788845858.263726:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a0c2067c000 10000000:01000000:2.0:1788845858.263729:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788845858.263734:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a0c2067c000 from 1 10000000:01000000:2.0:1788845858.263737:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788845858.263763:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.263784:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845858.263794:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845858.263812:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738994176:0@lo:101: 00000100:00100000:2.0:1788845858.263852:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845858.263890:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c34e77480 going to sleep for 11 seconds 00000100:00100000:1.0:1788845858.263926:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738994176 00000100:00100000:1.0:1788845858.263932:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738994176 00000100:00100000:1.0:1788845858.263972:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788845858.263980:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:7630:x1875740738994176:12345-0@lo:101: 00010000:00010000:1.0:1788845858.263990:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845858.264001:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475000/0x1345bc80c773ee26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ee1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.264021:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475000/0x1345bc80c773ee26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ee1f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.264032:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475000/0x1345bc80c773ee26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ee1f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.264040:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475000, rc 0) 00000100:00100000:1.0:1788845858.264093:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:7630:x1875740738994176:12345-0@lo:101: Request processed in 114us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.264099:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788845858.264206:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738994176:0@lo:101: 00010000:00010000:3.0:1788845858.264218:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee26 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.264227:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ee26 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845858.264306:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738994304:0@lo:501: 00000100:00100000:3.0:1788845858.264333:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845858.264363:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845858.264370:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738994304 00000100:00100000:0.0:1788845858.264376:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738994304 00000100:00100000:0.0:1788845858.264408:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788845858.264415:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:7630:x1875740738994304:12345-0@lo:501: 00000100:00100000:0.0:1788845858.264639:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:7630:x1875740738994304:12345-0@lo:501: Request processed in 223us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845858.264646:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788845858.264887:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738994304:0@lo:501: 00000100:00100000:3.0:1788845858.264914:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738994432:0@lo:503: 00000100:00100000:3.0:1788845858.264950:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845858.264972:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845858.264998:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738994432 00000100:00100000:2.0:1788845858.265003:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738994432 00000100:00100000:2.0:1788845858.265034:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788845858.265040:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:7630:x1875740738994432:12345-0@lo:503: 00000100:00100000:2.0:1788845858.265208:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:7630:x1875740738994432:12345-0@lo:503: Request processed in 167us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845858.265215:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788845858.265319:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738994432:0@lo:503: 00000040:00080000:3.0:1788845858.265566:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788845858.265615:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738994560:0@lo:502: 00000100:00100000:3.0:1788845858.265668:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845858.265698:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845858.265765:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738994560 00000100:00100000:0.0:1788845858.265770:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738994560 00000100:00100000:0.0:1788845858.265798:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788845858.265804:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:7630:x1875740738994560:12345-0@lo:502: 00000100:00100000:0.0:1788845858.265969:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:7630:x1875740738994560:12345-0@lo:502: Request processed in 163us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845858.265976:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788845858.267538:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738994560:0@lo:502: 00000040:00080000:3.0:1788845858.268510:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788845858.268575:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788845858.268608:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788845858.268664:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788845858.268703:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788845858.268762:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788845858.268800:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788845858.268832:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788845858.268878:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788845858.268913:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788845858.268947:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788845858.268993:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788845858.269031:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788845858.269077:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788845858.269125:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788845858.269207:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788845858.269246:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788845858.269295:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788845858.269335:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788845858.269370:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788845858.269418:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788845858.269455:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788845858.269487:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788845858.269532:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788845858.269570:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788845858.269623:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788845858.269684:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788845858.269721:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788845858.269756:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788845858.269805:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788845858.269845:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788845858.269879:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788845858.269914:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788845858.269963:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788845858.270000:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788845858.270071:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788845858.270110:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788845858.270182:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738994688:0@lo:502: 00000100:00100000:3.0:1788845858.270255:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845858.270303:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845858.270886:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738994688 00000100:00100000:1.0:1788845858.270901:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738994688 00000100:00100000:1.0:1788845858.270955:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788845858.270965:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:7630:x1875740738994688:12345-0@lo:502: 00000100:00100000:1.0:1788845858.271223:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:7630:x1875740738994688:12345-0@lo:502: Request processed in 258us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.271230:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788845858.276128:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738994688:0@lo:502: 00000040:00080000:0.0:1788845858.281405:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788845858.281428:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788845858.283487:0:7641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788845858.283516:0:7641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a0b06a219b8) 00000020:00000080:2.0:1788845858.283538:0:7641:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788845858.283618:0:7641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a0c2067c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788845858.283623:0:7641:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a0c2067c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788845858.283626:0:7641:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a0c2067c000 3 00010000:00080000:2.0:1788845858.283675:0:7641:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a0b04969000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.148@tcp at head 00010000:00010000:2.0:1788845858.286982:0:7641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788845858.287455:0:7641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788845858.287490:0:7641:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788845858.287502:0:7641:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1345bc80c773ee34 00000100:00080000:2.0:1788845858.287512:0:7641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788845858.287527:0:7641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a0b04969000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1788845858.287560:0:7641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c088de300 x1875740738994816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788845858.287586:0:7641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788845858.287775:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875740738994816:0@lo:38: 00000100:00100000:0.0:1788845858.287851:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845858.287940:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738994816 00000100:00100000:2.0:1788845858.287947:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738994816 00000100:00100000:2.0:1788845858.287984:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788845858.287991:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1875740738994816:12345-0@lo:38: 00010000:00080000:2.0:1788845858.288012:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1788845858.288052:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1345bc80c773ee3b 00000004:00100000:2.0:1788845858.288067:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788845858.288108:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9a0b0503f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845858.288188:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875740738994816:12345-0@lo:38: Request processed in 195us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845858.288315:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845858.288459:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875740738995072:0@lo:400: 00000100:00100000:3.0:1788845858.288489:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845858.288520:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845858.288526:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740738994944:0@lo:400: 00000100:00100000:3.0:1788845858.288549:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845858.288576:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740738995200:0@lo:400: 00000100:00100000:3.0:1788845858.288600:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845858.288631:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738995072 00000100:00100000:3.0:1788845858.288635:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738995072 00000100:00100000:3.0:1788845858.288799:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738994944 00000100:00100000:3.0:1788845858.288803:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738994944 00000100:00100000:3.0:1788845858.288820:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788845858.288827:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875740738995072:12345-0@lo:400: 00000100:00100000:3.0:1788845858.288872:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875740738995072:12345-0@lo:400: Request processed in 45us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845858.288878:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788845858.288891:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788845858.288897:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740738994944:12345-0@lo:400: 00000100:00100000:3.0:1788845858.288922:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740738994944:12345-0@lo:400: Request processed in 26us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845858.288928:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788845858.288947:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738995200 00000100:00100000:3.0:1788845858.288950:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738995200 00000100:00100000:3.0:1788845858.288975:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845858.288981:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740738995200:12345-0@lo:400: 00000100:00100000:3.0:1788845858.289012:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740738995200:12345-0@lo:400: Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845858.289116:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788845858.289134:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845858.289138:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788845858.289309:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c088de300 x1875740738994816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845858.289321:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788845858.289329:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788845858.289336:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788845858.289340:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788845858.289343:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0b04969000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788845858.289349:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875740738994816:0@lo:38: 00010000:00080000:3.0:1788845858.289506:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d9ee680 x1875740738995200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845858.289516:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740738995200:0@lo:400: 00010000:00080000:3.0:1788845858.289648:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d9ed500 x1875740738994944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845858.289671:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740738994944:0@lo:400: 00010000:00080000:3.0:1788845858.289684:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d9eca80 x1875740738995072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845858.289692:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875740738995072:0@lo:400: 00000040:00080000:3.0:1788845858.291458:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788845858.291672:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788845858.291697:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845858.291720:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee26 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.291730:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee26 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788845858.291775:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788845858.291777:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788845858.291783:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845858.291784:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845858.291785:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845858.291786:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845858.291787:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845858.291788:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845858.291789:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845858.291791:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845858.291792:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788845858.291795:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788845858.291797:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788845858.291798:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788845858.291799:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845858.291799:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845858.291800:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845858.291801:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845858.291802:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845858.291803:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845858.291804:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845858.291805:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845858.291806:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788845858.291829:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788845858.291856:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738995328:0@lo:253: 00000100:00100000:0.0:1788845858.291931:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845858.291967:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731900 going to sleep for 11 seconds 00000100:00100000:0.0:1788845858.292019:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da25500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1875740738995456:0@lo:901: 00000100:00100000:0.0:1788845858.292050:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845858.292066:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845858.292342:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738995328 00000100:00100000:0.0:1788845858.292348:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738995328 00000100:00100000:0.0:1788845858.292382:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788845858.292460:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:7630:x1875740738995328:12345-0@lo:253: 20000000:01000000:0.0:1788845858.292483:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788845858.292495:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788845858.294253:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738995456 00000100:00100000:2.0:1788845858.294265:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738995456 00000100:00100000:2.0:1788845858.294319:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845858.294328:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1875740738995456:12345-0@lo:901: 00000100:00100000:2.0:1788845858.294675:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1875740738995456:12345-0@lo:901: Request processed in 347us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845858.294682:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788845858.295008:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788845858.295057:0:7642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3da25500 x1875740738995456/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788845874 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845858.295072:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da25500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1875740738995456:0@lo:901: 20000000:01000000:0.0:1788845858.330921:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788845858.330973:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788845858.334807:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788845858.334816:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788845858.334854:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.334871:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773edcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773edc4 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.334881:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.334918:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773edcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773edc4 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.334930:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773edcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773edc4 expref: 14 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845858.334943:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875740738995584:0@lo:104: 00000100:00100000:1.0:1788845858.335005:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845858.335035:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c18719000 going to sleep for 11 seconds 00000100:00100000:3.0:1788845858.335092:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738995584 00000100:00100000:3.0:1788845858.335100:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738995584 00000100:00100000:3.0:1788845858.335149:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788845858.335174:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:5861:x1875740738995584:12345-0@lo:104: 00010000:00010000:3.0:1788845858.335187:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773edcb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845858.335243:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788845858.335248:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:5861:x1875740738995584:12345-0@lo:104: Request processed in 76us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845858.335254:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788845858.335546:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845858.335553:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773edcb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335561:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474200 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:0.0:1788845858.335565:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773edcb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335573:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773edcb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845858.335580:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773edcb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845858.335585:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845858.335611:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773edcb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335617:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845858.335632:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773edcb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335638:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773edc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773edcb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335678:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845858.335680:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845858.335681:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845858.335699:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740738995712:0@lo:103: 00000100:00100000:0.0:1788845858.335763:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845858.335799:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738995712 00000100:00100000:0.0:1788845858.335803:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738995712 00010000:00010000:0.0:1788845858.335818:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773edcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773edc4 expref: 15 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845858.335838:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788845858.335850:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26395c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:3310:x1875740738995712:12345-0@lo:103: 00010000:00010000:0.0:1788845858.335859:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845858.335864:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773edcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773edc4 expref: 15 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335873:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773edcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773edc4 expref: 15 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335887:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335894:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788845858.335907:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001383698s 00010000:00010000:0.0:1788845858.335911:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335928:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335934:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335940:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335945:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788845858.335949:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335957:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335966:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845858.335974:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845858.336004:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26395c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:3310:x1875740738995712:12345-0@lo:103: Request processed in 154us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845858.336010:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788845858.336064:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740738995712:0@lo:103: 00010000:00010000:1.0:1788845858.336853:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773edcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773edc4 expref: 14 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845858.336866:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875740738995584:0@lo:104: 00010000:00010000:1.0:1788845858.336880:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.336887:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.336892:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845858.336910:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01474000/0x1345bc80c773ee42 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845858.340202:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:7630:x1875740738995328:12345-0@lo:253: Request processed in 47726us (48252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845858.340216:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788845858.340470:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da26a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:355d8611-f7e8-4bd6-8079-f3ef5a03a561:7630:1875740738995328:0@lo:253: 10000000:01000000:0.0:1788845858.340484:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788845858.340487:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788845858.340489:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788845858.340490:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845858.340504:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845858.340506:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845858.340507:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845858.340508:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845858.340510:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845858.340511:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845858.340512:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845858.340514:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788845858.340527:0:7630:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788845858.345145:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788845858.345525:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788845858.345870:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788845858.346034:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788845858.346540:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788845858.346843:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788845858.348530:0:7630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788845858.470244:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788845858.552083:0:7630:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788845858.552090:0:7630:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788845858.552121:0:7630:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788845858.552277:0:7630:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788845858.552291:0:7630:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788845858.552443:0:7630:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:2.0:1788845859.239062:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740738995840:0@lo:13: 00000100:00100000:2.0:1788845859.239183:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845859.239418:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738995840 00000100:00100000:0.0:1788845859.239426:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738995840 00000100:00100000:0.0:1788845859.239477:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788845859.239486:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740738995840:12345-0@lo:13: 00002000:00000024:0.0:1788845859.239519:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845859.245098:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740738995840:12345-0@lo:13: Request processed in 5604us (5935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845859.245111:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788845859.247012:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d9eca80 x1875740738995840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845859.247062:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740738995840:0@lo:13: 00010000:00010000:3.0:1788845859.496566:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845860.520707:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845861.542346:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845862.568371:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845863.344511:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740738995968:0@lo:400: 00000100:00100000:1.0:1788845863.344573:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845863.344609:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740738996480:0@lo:400: 00000100:00100000:1.0:1788845863.344671:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845863.344693:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845863.344699:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740738996352:0@lo:400: 00000100:00100000:1.0:1788845863.344718:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845863.344740:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740738996096:0@lo:400: 00000100:00100000:1.0:1788845863.344757:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845863.344770:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845863.344774:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740738996224:0@lo:400: 00000100:00100000:1.0:1788845863.344789:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845863.344812:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738995968 00000100:00100000:1.0:1788845863.344819:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738995968 00000100:00100000:1.0:1788845863.344854:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788845863.344862:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:3308:x1875740738995968:12345-0@lo:400: 00000100:00100000:1.0:1788845863.344898:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:3308:x1875740738995968:12345-0@lo:400: Request processed in 37us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845863.344918:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788845863.344946:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738996480 00000100:00100000:1.0:1788845863.344949:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738996480 00000100:00100000:1.0:1788845863.344974:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738996096 00000100:00100000:1.0:1788845863.344976:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738996096 00000100:00100000:1.0:1788845863.345308:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738996224 00000100:00100000:1.0:1788845863.345312:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738996224 00000100:00100000:1.0:1788845863.345328:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845863.345334:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740738996480:12345-0@lo:400: 00000100:00100000:1.0:1788845863.345365:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740738996480:12345-0@lo:400: Request processed in 32us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845863.345371:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845863.345383:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845863.345389:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740738996096:12345-0@lo:400: 00000100:00100000:1.0:1788845863.345429:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740738996096:12345-0@lo:400: Request processed in 40us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845863.345434:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845863.345445:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788845863.345450:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740738996224:12345-0@lo:400: 00000100:00100000:1.0:1788845863.345475:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740738996224:12345-0@lo:400: Request processed in 25us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845863.345480:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788845863.345497:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738996352 00000100:00100000:1.0:1788845863.345501:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738996352 00000100:00100000:1.0:1788845863.345524:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845863.345530:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740738996352:12345-0@lo:400: 00000100:00100000:1.0:1788845863.345555:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740738996352:12345-0@lo:400: Request processed in 26us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845863.345567:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788845863.345606:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c206d1c00 x1875740738996352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845863.345618:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740738996352:0@lo:400: 00000100:00100000:1.0:1788845863.345638:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740738995968:0@lo:400: 00010000:00080000:1.0:1788845863.345646:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c206d2d80 x1875740738996480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845863.345654:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740738996480:0@lo:400: 00000100:00080000:1.0:1788845863.345673:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845863.345676:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788845863.345849:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c206d3b80 x1875740738996224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845863.345902:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740738996224:0@lo:400: 00010000:00080000:2.0:1788845863.345912:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c206d0000 x1875740738996096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845863.345919:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740738996096:0@lo:400: 00010000:00010000:2.0:1788845863.595414:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845864.359193:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740738996608:0@lo:13: 00000100:00100000:2.0:1788845864.359259:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845864.359332:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738996608 00000100:00100000:2.0:1788845864.359339:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738996608 00000100:00100000:2.0:1788845864.359388:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788845864.359397:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740738996608:12345-0@lo:13: 00002000:00000024:2.0:1788845864.359430:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845864.359475:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740738996608:12345-0@lo:13: Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845864.359483:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788845864.359527:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c088dd180 x1875740738996608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845864.359546:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740738996608:0@lo:13: 00000001:02000400:0.0:1788845864.510511:0:7984:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788845864.615511:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845865.641491:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788845866.406270:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788845866.406278:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a0c3c96b800 from 30 10000000:01000000:0.0:1788845866.406283:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788845866.406329:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845866.406352:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845866.406363:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845866.406386:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738996736:0@lo:101: 00000100:00100000:0.0:1788845866.406451:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845866.406517:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845866.407721:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738996736 00000100:00100000:1.0:1788845866.407731:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738996736 00000100:00100000:1.0:1788845866.407792:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788845866.407801:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:5842:x1875740738996736:12345-0@lo:101: 00010000:00010000:1.0:1788845866.407815:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845866.407830:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ee50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ee49 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.407857:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ee50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ee49 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.407869:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ee50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ee49 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.407889:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475800, rc 0) 00000100:00100000:1.0:1788845866.407951:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:5842:x1875740738996736:12345-0@lo:101: Request processed in 151us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845866.407970:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788845866.409638:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738996736:0@lo:101: 00010000:00010000:0.0:1788845866.409664:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee50 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845866.409677:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ee50 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845866.409751:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738996864:0@lo:501: 00000100:00100000:0.0:1788845866.409797:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845866.409844:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845866.409974:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738996864 00000100:00100000:2.0:1788845866.409980:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738996864 00000100:00100000:2.0:1788845866.410025:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788845866.410046:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:5842:x1875740738996864:12345-0@lo:501: 00000100:00100000:2.0:1788845866.410428:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:5842:x1875740738996864:12345-0@lo:501: Request processed in 382us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845866.410436:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788845866.410916:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738996864:0@lo:501: 00000100:00100000:3.0:1788845866.410955:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738996992:0@lo:503: 00000100:00100000:3.0:1788845866.411001:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845866.411075:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c08ec5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788845866.411193:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738996992 00000100:00100000:2.0:1788845866.411200:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738996992 00000100:00100000:2.0:1788845866.411338:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788845866.411351:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:5842:x1875740738996992:12345-0@lo:503: 00000100:00100000:2.0:1788845866.411871:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:5842:x1875740738996992:12345-0@lo:503: Request processed in 522us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845866.411879:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788845866.411981:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738996992:0@lo:503: 00000100:00100000:1.0:1788845866.412426:0:8088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8088:1875740738997120:0@lo:502: 00000100:00100000:1.0:1788845866.412540:0:8088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845866.412633:0:8088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788845866.412726:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738997120 00000100:00100000:0.0:1788845866.412733:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738997120 00000100:00100000:0.0:1788845866.412800:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788845866.412808:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:8088:x1875740738997120:12345-0@lo:502: 00000100:00100000:0.0:1788845866.413039:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:8088:x1875740738997120:12345-0@lo:502: Request processed in 231us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845866.413046:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788845866.413119:0:8088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8088:1875740738997120:0@lo:502: 00000100:00100000:2.0:1788845866.413178:0:8088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8088:1875740738997248:0@lo:502: 00000100:00100000:2.0:1788845866.413206:0:8088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845866.413477:0:8088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c34e77f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845866.413678:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738997248 00000100:00100000:1.0:1788845866.413683:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738997248 00000100:00100000:1.0:1788845866.413710:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788845866.413717:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:8088:x1875740738997248:12345-0@lo:502: 00000100:00100000:1.0:1788845866.414027:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:8088:x1875740738997248:12345-0@lo:502: Request processed in 310us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845866.414035:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788845866.414174:0:8088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8088:1875740738997248:0@lo:502: 00000040:00080000:2.0:1788845866.414202:0:8088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788845866.414697:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788845866.414719:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845866.414730:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee50 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845866.414741:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee50 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845866.414750:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788845866.414753:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788845866.414756:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788845866.414784:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845866.414791:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845866.414799:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845866.414813:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738997376:0@lo:101: 00000100:00100000:0.0:1788845866.414849:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845866.414964:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845866.414999:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738997376 00000100:00100000:1.0:1788845866.415004:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738997376 00000100:00100000:1.0:1788845866.415066:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788845866.415074:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:5842:x1875740738997376:12345-0@lo:101: 00010000:00010000:1.0:1788845866.415083:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845866.415094:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ee5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ee57 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.415114:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ee5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ee57 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.415124:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ee5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ee57 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.415132:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475e00, rc 0) 00000100:00100000:1.0:1788845866.415189:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740738997376:12345-0@lo:101: Request processed in 116us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845866.415203:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788845866.415276:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738997376:0@lo:101: 00010000:00010000:3.0:1788845866.415288:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845866.415296:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ee5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845866.415339:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738997504:0@lo:501: 00000100:00100000:3.0:1788845866.415364:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845866.415747:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c08ec5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845866.415802:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738997504 00000100:00100000:0.0:1788845866.415807:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738997504 00000100:00100000:0.0:1788845866.415829:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788845866.415835:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740738997504:12345-0@lo:501: 00000100:00100000:0.0:1788845866.416136:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740738997504:12345-0@lo:501: Request processed in 299us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845866.416143:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788845866.416449:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738997504:0@lo:501: 00000100:00100000:3.0:1788845866.416561:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738997632:0@lo:503: 00000100:00100000:3.0:1788845866.416684:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845866.416748:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c08ec5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845866.416784:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738997632 00000100:00100000:0.0:1788845866.416789:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738997632 00000100:00100000:0.0:1788845866.416855:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788845866.416863:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740738997632:12345-0@lo:503: 00000100:00100000:0.0:1788845866.417732:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740738997632:12345-0@lo:503: Request processed in 867us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845866.417740:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788845866.417817:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738997632:0@lo:503: 00000100:00100000:0.0:1788845866.418381:0:8089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8089:1875740738997760:0@lo:502: 00000100:00100000:0.0:1788845866.418426:0:8089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845866.418493:0:8089:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412900 going to sleep for 11 seconds 00000100:00100000:2.0:1788845866.418672:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738997760 00000100:00100000:2.0:1788845866.418679:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738997760 00000100:00100000:2.0:1788845866.418756:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788845866.418765:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:8089:x1875740738997760:12345-0@lo:502: 00000100:00100000:2.0:1788845866.418998:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:8089:x1875740738997760:12345-0@lo:502: Request processed in 233us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845866.419005:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788845866.419077:0:8089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8089:1875740738997760:0@lo:502: 00000020:01000000:0.0:1788845866.419103:0:8089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845866.419111:0:8089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845866.419114:0:8089:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788845866.419118:0:8089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788845866.419119:0:8089:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788845866.419136:0:8089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8089:1875740738997888:0@lo:502: 00000100:00100000:0.0:1788845866.419188:0:8089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845866.425545:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738997888 00000100:00100000:1.0:1788845866.425559:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738997888 00000100:00100000:1.0:1788845866.425624:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788845866.425634:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:8089:x1875740738997888:12345-0@lo:502: 00000100:00100000:1.0:1788845866.425885:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:8089:x1875740738997888:12345-0@lo:502: Request processed in 252us (6695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845866.425893:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788845866.425964:0:8089:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412900 going to sleep for 11 seconds 00000100:00100000:1.0:1788845866.425988:0:8089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da25880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8089:1875740738997888:0@lo:502: 00000020:01000000:1.0:1788845866.426020:0:8089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845866.426027:0:8089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845866.426029:0:8089:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788845866.426033:0:8089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788845866.426848:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788845866.426882:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788845866.426901:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845866.426913:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845866.426923:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788845866.426925:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a0c0942a000 from 30 10000000:01000000:3.0:1788845866.426928:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788845866.426960:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845866.426968:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845866.426977:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845866.427000:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738998016:0@lo:101: 00000100:00100000:3.0:1788845866.427045:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845866.427076:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c08ec5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788845866.427199:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738998016 00000100:00100000:1.0:1788845866.427205:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738998016 00000100:00100000:1.0:1788845866.427232:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788845866.427240:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740738998016:12345-0@lo:101: 00010000:00010000:1.0:1788845866.427530:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845866.427544:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475600/0x1345bc80c773ee6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ee65 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.427566:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475600/0x1345bc80c773ee6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ee65 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.427577:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475600/0x1345bc80c773ee6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ee65 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.427595:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475600, rc 0) 00000100:00100000:1.0:1788845866.427686:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738998016:12345-0@lo:101: Request processed in 447us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845866.427692:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788845866.428524:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738998016:0@lo:101: 00010000:00010000:3.0:1788845866.428602:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845866.428625:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ee6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845866.428688:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738998144:0@lo:501: 00000100:00100000:3.0:1788845866.428733:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845866.428761:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c08ec5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788845866.428908:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738998144 00000100:00100000:1.0:1788845866.428914:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738998144 00000100:00100000:1.0:1788845866.428949:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788845866.428956:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738998144:12345-0@lo:501: 00000100:00100000:1.0:1788845866.430079:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738998144:12345-0@lo:501: Request processed in 1118us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845866.430088:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788845866.430418:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738998144:0@lo:501: 00000100:00100000:3.0:1788845866.430465:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738998272:0@lo:503: 00000100:00100000:3.0:1788845866.430508:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845866.430530:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c08ec5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845866.430641:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738998272 00000100:00100000:0.0:1788845866.430647:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738998272 00000100:00100000:0.0:1788845866.430688:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788845866.430695:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738998272:12345-0@lo:503: 00000100:00100000:0.0:1788845866.430918:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738998272:12345-0@lo:503: Request processed in 221us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845866.430924:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788845866.431005:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738998272:0@lo:503: 00000100:00100000:0.0:1788845866.431579:0:8090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da25c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8090:1875740738998400:0@lo:502: 00000100:00100000:0.0:1788845866.431713:0:8090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845866.431803:0:8090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c364126c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845866.431934:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738998400 00000100:00100000:1.0:1788845866.431940:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738998400 00000100:00100000:1.0:1788845866.432008:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788845866.432017:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:8090:x1875740738998400:12345-0@lo:502: 00000100:00100000:1.0:1788845866.432372:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:8090:x1875740738998400:12345-0@lo:502: Request processed in 356us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845866.432381:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788845866.432492:0:8090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da25c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8090:1875740738998400:0@lo:502: 00000100:00100000:0.0:1788845866.432535:0:8090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da25c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8090:1875740738998528:0@lo:502: 00000100:00100000:0.0:1788845866.432569:0:8090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845866.432899:0:8090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c364126c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845866.433047:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738998528 00000100:00100000:1.0:1788845866.433052:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738998528 00000100:00100000:1.0:1788845866.433087:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788845866.433095:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:8090:x1875740738998528:12345-0@lo:502: 00000100:00100000:1.0:1788845866.433287:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:8090:x1875740738998528:12345-0@lo:502: Request processed in 192us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845866.433294:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788845866.433435:0:8090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da25c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8090:1875740738998528:0@lo:502: 00000040:00080000:0.0:1788845866.433456:0:8090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788845866.433799:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788845866.433842:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788845866.433852:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.433863:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845866.433873:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788845866.433875:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a0c0942a000 from 5 10000000:01000000:1.0:1788845866.433878:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788845866.433906:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.433915:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.433924:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845866.434709:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738998656:0@lo:101: 00000100:00100000:1.0:1788845866.434766:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845866.434898:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165840 going to sleep for 11 seconds 00000100:00100000:2.0:1788845866.434963:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738998656 00000100:00100000:2.0:1788845866.434970:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738998656 00000100:00100000:2.0:1788845866.435030:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788845866.435039:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740738998656:12345-0@lo:101: 00010000:00010000:2.0:1788845866.435052:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845866.435068:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c02825a00/0x1345bc80c773ee7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ee73 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845866.435091:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02825a00/0x1345bc80c773ee7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ee73 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845866.435102:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c02825a00/0x1345bc80c773ee7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ee73 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845866.435111:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02825a00, rc 0) 00000100:00100000:2.0:1788845866.435182:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740738998656:12345-0@lo:101: Request processed in 115us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845866.435188:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788845866.435288:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738998656:0@lo:101: 00010000:00010000:1.0:1788845866.435303:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.435313:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845866.435375:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738998784:0@lo:256: 00000100:00100000:1.0:1788845866.435405:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845866.435432:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165840 going to sleep for 11 seconds 00000100:00100000:0.0:1788845866.435547:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738998784 00000100:00100000:0.0:1788845866.435551:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738998784 00000100:00100000:0.0:1788845866.435573:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788845866.435579:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740738998784:12345-0@lo:256: 20000000:01000000:0.0:1788845866.435601:0:5840:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788845866.435625:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788845866.435629:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788845866.435706:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740738998784:12345-0@lo:256: Request processed in 127us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845866.435713:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788845866.435828:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738998784:0@lo:256: 10000000:01000000:1.0:1788845866.435879:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788845866.435885:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.435894:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845866.435902:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788845866.435905:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788845866.435908:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788845866.435926:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.435932:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.435938:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845866.435950:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738998912:0@lo:101: 00000100:00100000:1.0:1788845866.435976:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845866.435998:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165840 going to sleep for 11 seconds 00000100:00100000:0.0:1788845866.436180:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738998912 00000100:00100000:0.0:1788845866.436184:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738998912 00000100:00100000:0.0:1788845866.436202:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788845866.436208:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740738998912:12345-0@lo:101: 00010000:00010000:0.0:1788845866.436215:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845866.436224:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c00031200/0x1345bc80c773ee88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ee81 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845866.436239:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c00031200/0x1345bc80c773ee88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ee81 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845866.436268:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c00031200/0x1345bc80c773ee88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ee81 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845866.436276:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00031200, rc 0) 00000100:00100000:0.0:1788845866.436306:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740738998912:12345-0@lo:101: Request processed in 98us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845866.436312:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788845866.436490:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738998912:0@lo:101: 00010000:00010000:1.0:1788845866.436506:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845866.436514:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ee88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845866.436566:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738999040:0@lo:501: 00000100:00100000:1.0:1788845866.436948:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845866.436983:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165840 going to sleep for 11 seconds 00000100:00100000:2.0:1788845866.437024:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738999040 00000100:00100000:2.0:1788845866.437029:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738999040 00000100:00100000:2.0:1788845866.437060:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788845866.437067:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740738999040:12345-0@lo:501: 00000100:00100000:2.0:1788845866.437445:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740738999040:12345-0@lo:501: Request processed in 377us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845866.437453:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788845866.437577:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738999040:0@lo:501: 00000100:00100000:1.0:1788845866.437626:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738999168:0@lo:503: 00000100:00100000:1.0:1788845866.437664:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845866.437691:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165840 going to sleep for 11 seconds 00000100:00100000:2.0:1788845866.437786:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738999168 00000100:00100000:2.0:1788845866.437791:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738999168 00000100:00100000:2.0:1788845866.437820:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788845866.437828:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740738999168:12345-0@lo:503: 00000100:00100000:2.0:1788845866.438101:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740738999168:12345-0@lo:503: Request processed in 273us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845866.438114:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788845866.438393:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740738999168:0@lo:503: 00000100:00100000:3.0:1788845866.441037:0:8091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8091:1875740738999296:0@lo:502: 00000100:00100000:3.0:1788845866.441105:0:8091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845866.441201:0:8091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c08ec5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845866.441971:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738999296 00000100:00100000:2.0:1788845866.441979:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738999296 00000100:00100000:2.0:1788845866.442062:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788845866.442071:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:8091:x1875740738999296:12345-0@lo:502: 00000100:00100000:2.0:1788845866.442723:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:8091:x1875740738999296:12345-0@lo:502: Request processed in 652us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845866.442732:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788845866.442886:0:8091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8091:1875740738999296:0@lo:502: 00000020:01000000:3.0:1788845866.442928:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788845866.442935:0:8091:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788845866.442942:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845866.442944:0:8091:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788845866.442949:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788845866.442952:0:8091:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:3.0:1788845866.442973:0:8091:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788845866.442976:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788845866.442990:0:8091:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a0c35178000) 00000020:00000080:3.0:1788845866.443008:0:8091:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788845866.443012:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788845866.443079:0:8091:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788845866.443084:0:8091:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788845866.443089:0:8091:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773ee96 00010000:00080000:3.0:1788845866.443114:0:8091:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a0c3d13f000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1788845866.446940:0:8091:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788845866.447313:0:8091:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788845866.447327:0:8091:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788845866.448862:0:8091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845866.449082:0:8091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788845866.449125:0:8091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788845866.449558:0:8091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788845866.452670:0:8092:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845866.452678:0:8092:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788845866.454690:0:8091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788845866.454704:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788845866.454743:0:8091:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788845866.454765:0:8091:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1345bc80c773ee9d 00000100:00080000:3.0:1788845866.454776:0:8091:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788845866.454782:0:8091:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a0c3d13f000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1788845866.454817:0:8091:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3d9ed500 x1875740738999424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788845866.454843:0:8091:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788845866.454896:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845866.454900:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845866.454902:0:8091:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788845866.454905:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845866.454909:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845866.454911:0:8091:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788845866.454914:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788845866.454916:0:8091:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788845866.454940:0:8091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8091:1875740738999552:0@lo:502: 00000100:00100000:0.0:1788845866.454962:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740738999424:0@lo:8: 00000100:00100000:2.0:1788845866.454985:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740738999680:0@lo:400: 00000100:00100000:3.0:1788845866.455010:0:8091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845866.455016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845866.455025:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845866.455691:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738999552 00000100:00100000:3.0:1788845866.455699:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738999552 00000100:00100000:3.0:1788845866.455775:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788845866.455784:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:8091:x1875740738999552:12345-0@lo:502: 00000100:00100000:3.0:1788845866.456000:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:8091:x1875740738999552:12345-0@lo:502: Request processed in 216us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845866.456013:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788845866.456101:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738999424 00000100:00100000:0.0:1788845866.456106:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738999424 00000100:00100000:3.0:1788845866.456542:0:8091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c08ec59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845866.456564:0:8091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8091:1875740738999552:0@lo:502: 00000100:00100000:2.0:1788845866.456650:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845866.456659:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875740739000064:0@lo:400: 00000020:01000000:3.0:1788845866.456667:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845866.456673:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845866.456675:0:8091:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788845866.456679:0:8091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1788845866.456691:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845866.456722:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740738999808:0@lo:400: 00000020:01000000:3.0:1788845866.456743:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:2.0:1788845866.456743:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845866.456759:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845866.456764:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740738999936:0@lo:400: 10000000:01000000:3.0:1788845866.456770:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788845866.456779:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845866.456784:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845866.456789:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845866.456798:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788845866.456800:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a0c088c4d28 from 1 10000000:01000000:3.0:1788845866.456803:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788845866.456826:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845866.456833:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845866.456842:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845866.456852:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739000192:0@lo:101: 00000100:00100000:3.0:1788845866.456876:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845866.456902:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c08ec59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845866.457003:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738999680 00000100:00100000:2.0:1788845866.457008:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738999680 00000100:00100000:2.0:1788845866.457034:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739000064 00000100:00100000:2.0:1788845866.457037:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739000064 00000100:00100000:2.0:1788845866.457053:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738999808 00000100:00100000:2.0:1788845866.457055:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738999808 00000100:00100000:2.0:1788845866.457066:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845866.457072:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740738999680:12345-0@lo:400: 00000100:00100000:2.0:1788845866.457107:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740738999680:12345-0@lo:400: Request processed in 34us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845866.457119:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845866.457134:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845866.457140:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875740739000064:12345-0@lo:400: 00000100:00100000:2.0:1788845866.457260:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875740739000064:12345-0@lo:400: Request processed in 119us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845866.457266:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845866.457279:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788845866.457285:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740738999808:12345-0@lo:400: 00000100:00100000:2.0:1788845866.457315:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740738999808:12345-0@lo:400: Request processed in 31us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845866.457321:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788845866.457344:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788845866.457365:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c088ddf80 x1875740738999808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845866.457377:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740738999808:0@lo:400: 00010000:00080000:2.0:1788845866.457401:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c088dd880 x1875740739000064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845866.457409:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875740739000064:0@lo:400: 00010000:00080000:2.0:1788845866.457615:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c088dd180 x1875740738999680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845866.457624:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740738999680:0@lo:400: 00000100:00100000:2.0:1788845866.457658:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739000192 00000100:00100000:2.0:1788845866.457662:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739000192 00000100:00100000:2.0:1788845866.457689:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788845866.457702:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739000192:12345-0@lo:101: 00010000:00010000:2.0:1788845866.457712:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845866.457724:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c02825600/0x1345bc80c773eeab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773eea4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845866.457745:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02825600/0x1345bc80c773eeab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773eea4 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845866.457755:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c02825600/0x1345bc80c773eeab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773eea4 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845866.457763:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02825600, rc 0) 00000100:00100000:2.0:1788845866.457791:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739000192:12345-0@lo:101: Request processed in 89us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845866.457796:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788845866.458369:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739000192:0@lo:101: 00010000:00010000:2.0:1788845866.458385:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773eeab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845866.458395:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773eeab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845866.459311:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739000320:0@lo:501: 00000100:00100000:2.0:1788845866.459358:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845866.459390:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c04f32900 going to sleep for 11 seconds 00000100:00100000:0.0:1788845866.461746:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740738999936 00000100:00100000:0.0:1788845866.461760:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740738999936 00000100:00080000:2.0:1788845866.461838:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845866.462932:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788845866.462948:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740738999936:12345-0@lo:400: 00000100:00100000:1.0:1788845866.463211:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788845866.463222:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788845866.463524:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788845866.463537:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845866.463544:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875740738999424:12345-0@lo:8: 00000100:00100000:0.0:1788845866.463554:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740738999936:12345-0@lo:400: Request processed in 611us (6766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845866.463564:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788845866.463572:0:6688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00010000:00080000:1.0:1788845866.463818:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c088dd500 x1875740738999936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845866.463832:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740738999936:0@lo:400: 00000020:00000080:3.0:1788845866.463972:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1345bc80c773eeb2 00002000:00100000:3.0:1788845866.463990:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a0c34df1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788845866.463994:0:6688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788845866.463998:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788845866.464108:0:6688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788845866.464886:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788845866.464982:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9a0c34df2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845866.465052:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875740738999424:12345-0@lo:8: Request processed in 1506us (10038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845866.465060:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845866.465095:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739000320 00000100:00100000:3.0:1788845866.465101:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739000320 00000100:00100000:3.0:1788845866.465136:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788845866.465143:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739000320:12345-0@lo:501: 00000100:00100000:3.0:1788845866.465574:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739000320:12345-0@lo:501: Request processed in 430us (6215us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788845866.465583:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:1.0:1788845866.465624:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d9ed500 x1875740738999424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788845876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845866.465636:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1788845866.465642:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739000320:0@lo:501: 00000100:00080000:1.0:1788845866.465645:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788845866.465656:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788845866.465669:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788845866.465672:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d13f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788845866.465682:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00000004:00080000:1.0:1788845866.465687:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00010000:00010000:3.0:1788845866.465693:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773eeab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845866.465696:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740738999424:0@lo:8: 00010000:00010000:3.0:1788845866.465723:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773eeab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845866.465727:0:8092:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788845866.465832:0:8092:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 198682677946ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788845866.515477:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788845866.515824:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:2.0:1788845866.515842:0:8093:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788845866.515870:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088ddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875740739000576:0@lo:7: 00000100:00100000:2.0:1788845866.515948:0:8093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845866.515994:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1167d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788845866.516095:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739000576 00000100:00100000:1.0:1788845866.516103:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739000576 00000100:00100000:1.0:1788845866.516193:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845866.516203:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8093:x1875740739000576:12345-0@lo:7: 00000100:00080000:2.0:1788845866.519239:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788845866.519736:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739000448:0@lo:13: 00000100:00100000:3.0:1788845866.519808:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845866.519958:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739000448 00000100:00100000:2.0:1788845866.519966:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739000448 00000100:00100000:2.0:1788845866.520017:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788845866.520026:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875740739000448:12345-0@lo:13: 00002000:00000024:2.0:1788845866.520057:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788845866.520108:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875740739000448:12345-0@lo:13: Request processed in 83us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845866.520115:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788845866.520294:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c088dd880 x1875740739000448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845866.520314:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739000448:0@lo:13: 00002000:00080000:1.0:1788845866.525306:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788845866.525318:0:6689:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788845866.525469:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8093:x1875740739000576:12345-0@lo:7: Request processed in 9263us (9517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845866.525480:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788845866.527475:0:8093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c088ddf80 x1875740739000576/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788845882 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845866.527492:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088ddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875740739000576:0@lo:7: 00000004:00080000:2.0:1788845866.527506:0:8093:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788845866.527551:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088ddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875740739000704:0@lo:5: 00000100:00100000:2.0:1788845866.527615:0:8093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845866.527665:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1167d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788845866.527804:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739000704 00000100:00100000:1.0:1788845866.527811:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739000704 00000100:00100000:1.0:1788845866.527863:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788845866.527871:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8093:x1875740739000704:12345-0@lo:5: 00002000:00080000:1.0:1788845866.527897:0:6690:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788845866.527900:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788845866.528292:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8093:x1875740739000704:12345-0@lo:5: Request processed in 421us (686us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788845866.528299:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788845866.528425:0:8093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c088ddf80 x1875740739000704/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845882 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845866.528438:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088ddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875740739000704:0@lo:5: 00000004:00080000:2.0:1788845866.528447:0:8093:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788845866.528471:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088ddc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875740739000832:0@lo:700: 00000100:00100000:2.0:1788845866.528498:0:8093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845866.528525:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1167d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788845866.528650:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739000832 00000100:00100000:1.0:1788845866.528656:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739000832 00000100:00100000:1.0:1788845866.528690:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845866.528698:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8093:x1875740739000832:12345-0@lo:700: 00000100:00100000:1.0:1788845866.528734:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1875740739000960:0@lo:700: 00000100:00100000:1.0:1788845866.528762:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845866.528789:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06b98600 going to sleep for 11 seconds 00000100:00100000:2.0:1788845866.529572:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739000960 00000100:00100000:2.0:1788845866.529579:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739000960 00000100:00100000:2.0:1788845866.529634:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788845866.529642:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1875740739000960:12345-0@lo:700: 40000000:02000000:0.0:1788845866.549598:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788845866.555923:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1875740739000960:12345-0@lo:700: Request processed in 26274us (27152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845866.555937:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788845866.556101:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c206d3100 x1875740739000960/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788845882 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845866.556117:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1875740739000960:0@lo:700: 40000000:02000000:2.0:1788845866.556129:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1788845866.626019:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788845866.626044:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788845866.626309:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8093:x1875740739000832:12345-0@lo:700: Request processed in 97607us (97805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845866.626325:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788845866.626561:0:8093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c088ddc00 x1875740739000832/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788845882 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845866.626571:0:8093:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788845866.626587:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088ddc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875740739000832:0@lo:700: 00010000:00010000:3.0:1788845866.662583:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:3.0:1788845866.665523:0:8093:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788845866.669030:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ec700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875740739001088:0@lo:5: 00000100:00100000:3.0:1788845866.669094:0:8093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845866.669307:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c08ec5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845866.669659:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739001088 00000100:00100000:0.0:1788845866.669667:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739001088 00000100:00100000:0.0:1788845866.669782:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845866.669793:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8093:x1875740739001088:12345-0@lo:5: 00002000:00080000:0.0:1788845866.679961:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788845866.679985:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788845866.693786:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8093:x1875740739001088:12345-0@lo:5: Request processed in 23987us (24683us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788845866.693799:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788845866.694091:0:8093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d9ec700 x1875740739001088/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845882 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845866.694107:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ec700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875740739001088:0@lo:5: 00000004:00080000:2.0:1788845866.694122:0:8093:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788845867.691913:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845868.712043:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788845869.223752:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1788845869.480757:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845869.480781:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739001216:0@lo:13: 00000100:00100000:2.0:1788845869.480848:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845869.481105:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739001216 00000100:00100000:1.0:1788845869.481113:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739001216 00000100:00100000:1.0:1788845869.481293:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845869.481303:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739001216:12345-0@lo:13: 00002000:00000024:1.0:1788845869.481336:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845869.481386:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739001216:12345-0@lo:13: Request processed in 85us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845869.481393:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788845869.481435:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c206d2680 x1875740739001216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845869.481453:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739001216:0@lo:13: 00000100:00080000:0.0:1788845869.482095:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845869.664490:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845869.664574:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720103552 00000100:00100000:2.0:1788845869.664583:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720103552 00000100:00100000:2.0:1788845869.664643:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 111 00000100:00100000:2.0:1788845869.664652:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1875740720103552:12345-192.168.206.48@tcp:250: 00010000:00080000:2.0:1788845869.664690:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9a77a96b-0efb-4559-b734-596c51917804@192.168.206.48@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:2.0:1788845869.664716:0:5839:0:(genops.c:1385:class_connect()) connect: client 9a77a96b-0efb-4559-b734-596c51917804, cookie 0x1345bc80c773eeb9 00000100:00080000:2.0:1788845869.664844:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9a0b05039000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845869.664912:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+5:2350:x1875740720103552:12345-192.168.206.48@tcp:250: Request processed in 260us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845869.664920:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 111 00000100:00100000:0.0:1788845869.667397:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845869.667480:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720103680 00000100:00100000:2.0:1788845869.667489:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720103680 00000100:00100000:2.0:1788845869.667541:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:2.0:1788845869.667551:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+5:5577:x1875740720103680:12345-192.168.206.48@tcp:101: 00010000:00010000:2.0:1788845869.667565:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845869.667580:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c02824a00/0x1345bc80c773eec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cbc2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845869.667618:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02824a00/0x1345bc80c773eec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc2 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845869.667641:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c02824a00/0x1345bc80c773eec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc2 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845869.667649:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02824a00, rc 0) 00000100:00100000:2.0:1788845869.667704:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+6:5577:x1875740720103680:12345-192.168.206.48@tcp:101: Request processed in 154us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845869.667711:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:1.0:1788845869.672247:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845869.673454:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720103808 00000100:00100000:3.0:1788845869.673466:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720103808 00000100:00100000:3.0:1788845869.673515:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:3.0:1788845869.673525:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+6:5577:x1875740720103808:12345-192.168.206.48@tcp:501: 00000100:00100000:3.0:1788845869.673820:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+6:5577:x1875740720103808:12345-192.168.206.48@tcp:501: Request processed in 296us (1578us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788845869.673835:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:2.0:1788845869.678783:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845869.678879:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720103936 00000100:00100000:3.0:1788845869.678889:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720103936 00000100:00100000:0.0:1788845869.680280:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:0.0:1788845869.680296:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+6:5577:x1875740720103936:12345-192.168.206.48@tcp:101: 00010000:00010000:0.0:1788845869.680314:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845869.680331:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c00031600/0x1345bc80c773eec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cbc9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845869.680362:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c00031600/0x1345bc80c773eec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc9 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845869.680375:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c00031600/0x1345bc80c773eec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc9 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845869.680384:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00031600, rc 0) 00000100:00100000:0.0:1788845869.680444:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+7:5577:x1875740720103936:12345-192.168.206.48@tcp:101: Request processed in 152us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845869.680453:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:3.0:1788845869.682709:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845869.682841:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720104064 00000100:00100000:2.0:1788845869.682850:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720104064 00000100:00100000:2.0:1788845869.682917:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:2.0:1788845869.682926:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+7:5577:x1875740720104064:12345-192.168.206.48@tcp:501: 00000100:00100000:2.0:1788845869.683199:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+8:5577:x1875740720104064:12345-192.168.206.48@tcp:501: Request processed in 273us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845869.683207:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:2.0:1788845869.695522:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845869.695609:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720104192 00000100:00100000:0.0:1788845869.695630:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720104192 00000100:00100000:0.0:1788845869.695681:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:0.0:1788845869.695691:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+8:5577:x1875740720104192:12345-192.168.206.48@tcp:503: 00000100:00100000:0.0:1788845869.695933:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+8:5577:x1875740720104192:12345-192.168.206.48@tcp:503: Request processed in 243us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845869.695941:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:1.0:1788845869.700361:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845869.700445:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720104320 00000100:00100000:3.0:1788845869.700455:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720104320 00000100:00100000:3.0:1788845869.700514:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:3.0:1788845869.700525:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+8:5595:x1875740720104320:12345-192.168.206.48@tcp:502: 00000100:00100000:3.0:1788845869.700860:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+8:5595:x1875740720104320:12345-192.168.206.48@tcp:502: Request processed in 335us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845869.700869:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:0.0:1788845869.731171:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845869.731293:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720104448 00000100:00100000:2.0:1788845869.731303:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720104448 00000100:00100000:2.0:1788845869.731350:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:2.0:1788845869.731360:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+8:5595:x1875740720104448:12345-192.168.206.48@tcp:502: 00000100:00100000:2.0:1788845869.731586:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+8:5595:x1875740720104448:12345-192.168.206.48@tcp:502: Request processed in 226us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845869.731602:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 118 00010000:00010000:2.0:1788845869.736222:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845869.737580:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845869.739059:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720104576 00000100:00100000:3.0:1788845869.739071:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720104576 00000100:00100000:3.0:1788845869.739126:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:3.0:1788845869.739144:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+8:5577:x1875740720104576:12345-192.168.206.48@tcp:101: 00010000:00010000:3.0:1788845869.739182:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845869.739198:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c12f56800/0x1345bc80c773eece lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cbf3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845869.739225:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c12f56800/0x1345bc80c773eece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbf3 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845869.739236:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c12f56800/0x1345bc80c773eece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbf3 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845869.739245:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f56800, rc 0) 00000100:00100000:3.0:1788845869.739298:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+9:5577:x1875740720104576:12345-192.168.206.48@tcp:101: Request processed in 164us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845869.739315:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:1.0:1788845869.747024:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845869.747812:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720104704 00000100:00100000:2.0:1788845869.747824:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720104704 00000100:00100000:2.0:1788845869.747913:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:2.0:1788845869.747923:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+9:5577:x1875740720104704:12345-192.168.206.48@tcp:256: 20000000:01000000:2.0:1788845869.747952:0:5840:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788845869.747971:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788845869.747975:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788845869.747978:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788845869.747980:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788845869.749614:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+9:5577:x1875740720104704:12345-192.168.206.48@tcp:256: Request processed in 1685us (2591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845869.749635:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:0.0:1788845869.753080:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845869.753214:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720104832 00000100:00100000:3.0:1788845869.753224:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720104832 00000100:00100000:3.0:1788845869.753280:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:3.0:1788845869.753289:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+9:5577:x1875740720104832:12345-192.168.206.48@tcp:101: 00010000:00010000:3.0:1788845869.753307:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845869.753323:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c12f57600/0x1345bc80c773eed5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cbfa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845869.753349:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c12f57600/0x1345bc80c773eed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbfa expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845869.753360:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c12f57600/0x1345bc80c773eed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbfa expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845869.753370:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f57600, rc 0) 00000100:00100000:3.0:1788845869.753425:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+10:5577:x1875740720104832:12345-192.168.206.48@tcp:101: Request processed in 137us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845869.753432:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:2.0:1788845869.756562:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845869.756762:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720104960 00000100:00100000:3.0:1788845869.756772:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720104960 00000100:00100000:3.0:1788845869.756831:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:3.0:1788845869.756841:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:5577:x1875740720104960:12345-192.168.206.48@tcp:501: 00000100:00100000:3.0:1788845869.757222:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:5577:x1875740720104960:12345-192.168.206.48@tcp:501: Request processed in 381us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845869.757238:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:2.0:1788845869.759260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845869.759345:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720105088 00000100:00100000:3.0:1788845869.759354:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720105088 00000100:00100000:3.0:1788845869.759703:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:3.0:1788845869.759713:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:5577:x1875740720105088:12345-192.168.206.48@tcp:503: 00000100:00100000:3.0:1788845869.760030:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:5577:x1875740720105088:12345-192.168.206.48@tcp:503: Request processed in 317us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845869.760282:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:2.0:1788845869.771838:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845869.771919:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720105216 00000100:00100000:0.0:1788845869.771927:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720105216 00000100:00100000:0.0:1788845869.771972:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 124 00000100:00100000:0.0:1788845869.771981:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:5597:x1875740720105216:12345-192.168.206.48@tcp:502: 00000100:00100000:0.0:1788845869.772205:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:5597:x1875740720105216:12345-192.168.206.48@tcp:502: Request processed in 225us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845869.772213:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 124 00000100:00100000:0.0:1788845869.781289:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845869.783354:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720105344 00000100:00100000:0.0:1788845869.783368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720105344 00000100:00100000:0.0:1788845869.783428:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:0.0:1788845869.783440:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:5597:x1875740720105344:12345-192.168.206.48@tcp:502: 00000100:00100000:0.0:1788845869.783666:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:5597:x1875740720105344:12345-192.168.206.48@tcp:502: Request processed in 228us (2386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845869.783674:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:1.0:1788845869.788013:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845869.788078:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720105472 00000100:00100000:2.0:1788845869.788087:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720105472 00000100:00100000:2.0:1788845869.788130:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:2.0:1788845869.788236:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1875740720105472:12345-192.168.206.48@tcp:38: 00010000:00080000:2.0:1788845869.788264:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:2.0:1788845869.788313:0:5845:0:(genops.c:1385:class_connect()) connect: client 4592a189-21d8-449a-9335-07bfe0dc7877, cookie 0x1345bc80c773eedc 00000004:00100000:2.0:1788845869.788343:0:5845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788845869.788349:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788845869.828685:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9a0b0503e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845869.828759:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+6:2350:x1875740720105472:12345-192.168.206.48@tcp:38: Request processed in 40523us (40752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845869.828770:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00010000:00010000:3.0:1788845870.759197:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845870.839959:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845870.840034:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845870.840127:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720105600 00000100:00100000:1.0:1788845870.840146:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720105600 00000100:00100000:1.0:1788845870.840251:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720105728 00000100:00100000:1.0:1788845870.840255:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720105728 00000100:00100000:1.0:1788845870.840277:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1788845870.840297:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+7:0:x1875740720105600:12345-192.168.206.48@tcp:41: 00000004:00000024:1.0:1788845870.840338:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788845870.840446:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+7:0:x1875740720105600:12345-192.168.206.48@tcp:41: Request processed in 150us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845870.840453:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1788845870.840471:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:1.0:1788845870.840477:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:5577:x1875740720105728:12345-192.168.206.48@tcp:41: 00000004:00000024:1.0:1788845870.840488:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788845870.840510:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:5577:x1875740720105728:12345-192.168.206.48@tcp:41: Request processed in 33us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845870.840516:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00080000:0.0:1788845870.840848:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845870.845337:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845870.845432:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720105856 00000100:00100000:1.0:1788845870.845441:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720105856 00000100:00100000:1.0:1788845870.845498:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1788845870.845509:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:5577:x1875740720105856:12345-192.168.206.48@tcp:40: 00000100:00100000:1.0:1788845870.845600:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:5577:x1875740720105856:12345-192.168.206.48@tcp:40: Request processed in 92us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845870.845607:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1788845870.857824:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845870.857872:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845870.857954:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720105984 00000100:00100000:3.0:1788845870.857965:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720105984 00000100:00100000:3.0:1788845870.858015:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1788845870.858024:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875740720105984:12345-192.168.206.48@tcp:8: 00010000:00080000:3.0:1788845870.858066:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:3.0:1788845870.858096:0:6690:0:(genops.c:1385:class_connect()) connect: client 4592a189-21d8-449a-9335-07bfe0dc7877, cookie 0x1345bc80c773eee3 00002000:00100000:3.0:1788845870.858107:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4592a189-21d8-449a-9335-07bfe0dc7877/ffff9a0c3d13e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788845870.858140:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788845870.858477:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788845870.858507:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d138800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845870.858580:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2350:x1875740720105984:12345-192.168.206.48@tcp:8: Request processed in 555us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845870.858597:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1788845870.861788:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720106240 00000100:00100000:2.0:1788845870.861802:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720106240 00000100:00100000:2.0:1788845870.861877:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:2.0:1788845870.861889:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+10:2352:x1875740720106240:12345-192.168.206.48@tcp:400: 00000100:00100000:2.0:1788845870.861983:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+10:2352:x1875740720106240:12345-192.168.206.48@tcp:400: Request processed in 97us (4110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845870.861992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:1.0:1788845870.863911:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845870.863950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845870.864032:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720106368 00000100:00100000:2.0:1788845870.864041:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720106368 00000100:00100000:2.0:1788845870.864101:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:2.0:1788845870.864119:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+6:5577:x1875740720106368:12345-192.168.206.48@tcp:33: 00000100:00100000:0.0:1788845870.864376:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720106112 00000100:00100000:0.0:1788845870.864380:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720106112 00000100:00100000:0.0:1788845870.864414:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:0.0:1788845870.864419:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875740720106112:12345-192.168.206.48@tcp:8: 00010000:00080000:0.0:1788845870.864441:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1788845870.864468:0:6689:0:(genops.c:1385:class_connect()) connect: client 4592a189-21d8-449a-9335-07bfe0dc7877, cookie 0x1345bc80c773eeea 00002000:00100000:0.0:1788845870.864478:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4592a189-21d8-449a-9335-07bfe0dc7877/ffff9a0c352fb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788845870.864511:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788845870.864840:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788845870.864868:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9a0c352ff800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788845870.864931:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2350:x1875740720106112:12345-192.168.206.48@tcp:8: Request processed in 510us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845870.864939:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000004:00080000:2.0:1788845870.888006:0:5848:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 23789us 00000004:00200000:2.0:1788845870.908683:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788845870.908806:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+6:5577:x1875740720106368:12345-192.168.206.48@tcp:33: Request processed in 44691us (44849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845870.908816:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1788845871.103542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845871.103643:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720106496 00000100:00100000:2.0:1788845871.103653:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720106496 00000100:00100000:2.0:1788845871.103716:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1788845871.103726:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:5614:x1875740720106496:12345-192.168.206.48@tcp:101: 00010000:00010000:2.0:1788845871.103746:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845871.103815:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825c00/0x1345bc80c773eef1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cc24 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845871.103879:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773eef8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845871.103893:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773eef8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845871.103908:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773eef8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845871.103941:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788845871.103945:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845871.103959:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773eef8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845871.103982:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825c00/0x1345bc80c773eef1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc24 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845871.104000:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773eef8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc24 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845871.104025:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:2.0:1788845871.104028:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845871.104031:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02825800, rc 0) 00000100:00100000:2.0:1788845871.104093:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:5614:x1875740720106496:12345-192.168.206.48@tcp:101: Request processed in 368us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845871.104101:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1788845871.526381:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739001600:0@lo:400: 00000100:00100000:3.0:1788845871.526421:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739001728:0@lo:400: 00000100:00100000:0.0:1788845871.526495:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739001344:0@lo:13: 00000100:00100000:1.0:1788845871.526588:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739001472:0@lo:400: 00000100:00100000:0.0:1788845871.529002:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845871.529071:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739001984:0@lo:400: 00000100:00100000:0.0:1788845871.529108:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845871.529150:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845871.529170:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739002112:0@lo:400: 00000100:00100000:0.0:1788845871.529195:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845871.529234:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739001984 00000100:00100000:0.0:1788845871.529241:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739001984 00000100:00100000:0.0:1788845871.529293:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788845871.529305:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739001984:12345-0@lo:400: 00000100:00100000:0.0:1788845871.529360:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739001984:12345-0@lo:400: Request processed in 58us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845871.529367:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788845871.529390:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845871.529467:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739001984:0@lo:400: 00000100:00100000:0.0:1788845871.529508:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739001344 00000100:00100000:0.0:1788845871.529511:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739001344 00000100:00100000:0.0:1788845871.529543:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788845871.529549:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739001344:12345-0@lo:13: 00002000:00000024:0.0:1788845871.529591:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845871.529627:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739001344:12345-0@lo:13: Request processed in 78us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845871.529633:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788845871.529652:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788845871.529669:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c088dd180 x1875740739001344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845871.529679:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788845871.529694:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739001344:0@lo:13: 00000100:00100000:3.0:1788845871.529733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845871.529794:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739001728 00000100:00100000:3.0:1788845871.529798:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739001728 00000100:00100000:3.0:1788845871.529833:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788845871.529840:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739001728:12345-0@lo:400: 00000100:00100000:3.0:1788845871.529878:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739001728:12345-0@lo:400: Request processed in 39us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845871.529885:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788845871.529899:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845871.529930:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739001728:0@lo:400: 00000100:00100000:3.0:1788845871.530116:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739002112 00000100:00100000:3.0:1788845871.530123:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739002112 00000100:00100000:3.0:1788845871.530295:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845871.530305:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739002112:12345-0@lo:400: 00000100:00100000:3.0:1788845871.530346:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739002112:12345-0@lo:400: Request processed in 43us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845871.530352:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788845871.530386:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d661500 x1875740739002112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845871.530397:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739002112:0@lo:400: 00000100:00100000:2.0:1788845871.534001:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845871.534215:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739001600 00000100:00100000:0.0:1788845871.534223:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739001600 00000100:00100000:0.0:1788845871.534276:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788845871.534286:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739001600:12345-0@lo:400: 00000100:00100000:0.0:1788845871.534365:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739001600:12345-0@lo:400: Request processed in 80us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845871.534372:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788845871.534709:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739001600:0@lo:400: 00000100:00100000:1.0:1788845871.534809:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845871.534855:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739001856:0@lo:400: 00000100:00100000:1.0:1788845871.534901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845871.535035:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739001472 00000100:00100000:0.0:1788845871.535040:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739001472 00000100:00100000:0.0:1788845871.535078:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788845871.535085:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739001472:12345-0@lo:400: 00000100:00100000:0.0:1788845871.535142:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739001472:12345-0@lo:400: Request processed in 57us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845871.535148:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788845871.535323:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739001472:0@lo:400: 00000100:00100000:2.0:1788845871.535527:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739001856 00000100:00100000:2.0:1788845871.535532:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739001856 00000100:00100000:2.0:1788845871.535627:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788845871.535634:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739001856:12345-0@lo:400: 00000100:00100000:2.0:1788845871.535693:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739001856:12345-0@lo:400: Request processed in 60us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845871.535700:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788845871.535737:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d662680 x1875740739001856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845871.535748:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739001856:0@lo:400: 00000100:00080000:3.0:1788845871.536004:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788845871.782743:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845872.806948:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845873.180030:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845873.180124:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720106624 00000100:00100000:3.0:1788845873.180143:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720106624 00000100:00100000:3.0:1788845873.180248:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1788845873.180259:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+7:5667:x1875740720106624:12345-192.168.206.48@tcp:41: 00000004:00000024:3.0:1788845873.180320:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788845873.180390:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+7:5667:x1875740720106624:12345-192.168.206.48@tcp:41: Request processed in 133us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845873.180398:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00080000:0.0:1788845873.180506:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845873.189611:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845873.190547:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720106752 00000100:00100000:0.0:1788845873.190560:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720106752 00000100:00100000:0.0:1788845873.190852:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:0.0:1788845873.190861:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4592a189-21d8-449a-9335-07bfe0dc7877+6:5667:x1875740720106752:12345-192.168.206.48@tcp:13: 00002000:00000024:0.0:1788845873.190898:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845873.190988:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4592a189-21d8-449a-9335-07bfe0dc7877+6:5667:x1875740720106752:12345-192.168.206.48@tcp:13: Request processed in 128us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845873.190996:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00080000:3.0:1788845873.191268:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845873.195550:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845873.195707:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720106880 00000100:00100000:0.0:1788845873.195717:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720106880 00000100:00100000:0.0:1788845873.195786:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:0.0:1788845873.195796:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4592a189-21d8-449a-9335-07bfe0dc7877+6:5667:x1875740720106880:12345-192.168.206.48@tcp:13: 00002000:00000024:0.0:1788845873.195832:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845873.195887:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4592a189-21d8-449a-9335-07bfe0dc7877+6:5667:x1875740720106880:12345-192.168.206.48@tcp:13: Request processed in 93us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845873.195895:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00080000:3.0:1788845873.197271:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1788845873.648408:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4592a189-21d8-449a-9335-07bfe0dc7877 00010000:00010000:3.0:1788845873.831467:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845874.598393:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3537c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739002240:0@lo:13: 00000100:00100000:3.0:1788845874.598457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845874.598636:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739002240 00000100:00100000:0.0:1788845874.598644:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739002240 00000100:00100000:0.0:1788845874.598702:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845874.598711:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739002240:12345-0@lo:13: 00002000:00000024:0.0:1788845874.598730:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845874.598777:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739002240:12345-0@lo:13: Request processed in 68us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845874.598784:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788845874.598820:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3537c700 x1875740739002240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788845874.598871:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845874.604200:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3537c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739002240:0@lo:13: 00010000:00010000:3.0:1788845874.854336:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788845875.202320:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4592a189-21d8-449a-9335-07bfe0dc7877 00000001:00100000:0.0:1788845875.207749:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4592a189-21d8-449a-9335-07bfe0dc7877 00000001:02000400:1.0:1788845875.461746:0:8298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788845875.878404:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845876.129669:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845876.129713:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845876.129749:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845876.129850:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720107392 00000100:00100000:3.0:1788845876.129859:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720107392 00000100:00100000:3.0:1788845876.129914:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1788845876.129924:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+5:2353:x1875740720107392:12345-192.168.206.48@tcp:400: 00000100:00100000:3.0:1788845876.129994:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+5:2353:x1875740720107392:12345-192.168.206.48@tcp:400: Request processed in 72us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845876.130002:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00080000:3.0:1788845876.130034:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845876.130295:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845876.130530:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720107136 00000100:00100000:0.0:1788845876.130536:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720107136 00000100:00100000:0.0:1788845876.130594:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:0.0:1788845876.130602:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720107136:12345-192.168.206.48@tcp:400: 00000100:00100000:0.0:1788845876.130642:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720107136:12345-192.168.206.48@tcp:400: Request processed in 41us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845876.130649:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:3.0:1788845876.130775:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720107264 00000100:00100000:3.0:1788845876.130779:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720107264 00000100:00100000:3.0:1788845876.130816:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:3.0:1788845876.130824:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2353:x1875740720107264:12345-192.168.206.48@tcp:400: 00000100:00100000:3.0:1788845876.130853:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2353:x1875740720107264:12345-192.168.206.48@tcp:400: Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845876.130877:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00080000:1.0:1788845876.131117:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845876.131122:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845876.133263:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720107008 00000100:00100000:2.0:1788845876.133275:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720107008 00000100:00100000:2.0:1788845876.133503:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:2.0:1788845876.133513:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:2353:x1875740720107008:12345-192.168.206.48@tcp:400: 00000100:00100000:2.0:1788845876.133599:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:2353:x1875740720107008:12345-192.168.206.48@tcp:400: Request processed in 86us (3848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845876.133606:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:3.0:1788845876.647318:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739002368:0@lo:400: 00000100:00100000:3.0:1788845876.647385:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845876.647431:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739002880:0@lo:400: 00000100:00100000:3.0:1788845876.647461:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845876.647621:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845876.647629:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739002752:0@lo:400: 00000100:00100000:3.0:1788845876.647657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845876.647689:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739002496:0@lo:400: 00000100:00100000:3.0:1788845876.647710:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845876.647726:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739003008:0@lo:400: 00000100:00100000:3.0:1788845876.647742:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845876.647756:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845876.647760:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739002624:0@lo:400: 00000100:00100000:3.0:1788845876.647779:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845876.647811:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739002368 00000100:00100000:3.0:1788845876.647817:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739002368 00000100:00100000:3.0:1788845876.647861:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788845876.647869:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739002368:12345-0@lo:400: 00000100:00100000:3.0:1788845876.647916:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739002368:12345-0@lo:400: Request processed in 48us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845876.647924:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788845876.647957:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739002880 00000100:00100000:3.0:1788845876.647961:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739002880 00000100:00100000:3.0:1788845876.647990:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739002496 00000100:00100000:3.0:1788845876.647993:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739002496 00000100:00100000:3.0:1788845876.648012:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739002624 00000100:00100000:3.0:1788845876.648015:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739002624 00000100:00100000:3.0:1788845876.648028:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788845876.648034:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739002880:12345-0@lo:400: 00000100:00100000:3.0:1788845876.648064:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739002880:12345-0@lo:400: Request processed in 31us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845876.648071:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788845876.648082:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788845876.648087:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739002496:12345-0@lo:400: 00000100:00100000:3.0:1788845876.648114:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739002496:12345-0@lo:400: Request processed in 27us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845876.648120:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788845876.648129:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788845876.648135:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739002624:12345-0@lo:400: 00000100:00100000:3.0:1788845876.648218:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739002624:12345-0@lo:400: Request processed in 82us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845876.648224:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788845876.648241:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739002752 00000100:00100000:3.0:1788845876.648244:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739002752 00000100:00100000:3.0:1788845876.648265:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739003008 00000100:00100000:3.0:1788845876.648267:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739003008 00000100:00100000:3.0:1788845876.648285:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788845876.648291:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739002752:12345-0@lo:400: 00000100:00100000:3.0:1788845876.648320:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739002752:12345-0@lo:400: Request processed in 29us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845876.648326:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788845876.648336:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788845876.648341:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739003008:12345-0@lo:400: 00000100:00100000:3.0:1788845876.648372:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739003008:12345-0@lo:400: Request processed in 31us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845876.648378:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788845876.648405:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845876.648409:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845876.648411:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845876.648447:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739002624:0@lo:400: 00000100:00100000:3.0:1788845876.648459:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739002496:0@lo:400: 00010000:00080000:3.0:1788845876.648470:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d661180 x1875740739003008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845876.648569:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739003008:0@lo:400: 00010000:00080000:3.0:1788845876.648604:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d662d80 x1875740739002752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845876.648613:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739002752:0@lo:400: 00000100:00100000:3.0:1788845876.648621:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739002368:0@lo:400: 00000100:00100000:3.0:1788845876.648629:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739002880:0@lo:400: 00000100:00100000:0.0:1788845876.649476:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739003136:0@lo:13: 00000100:00100000:0.0:1788845876.649519:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845876.649566:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739003136 00000100:00100000:0.0:1788845876.649572:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739003136 00000100:00100000:0.0:1788845876.649622:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788845876.649629:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739003136:12345-0@lo:13: 00002000:00000024:0.0:1788845876.649657:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845876.649693:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739003136:12345-0@lo:13: Request processed in 64us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845876.649700:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788845876.649732:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3da24000 x1875740739003136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845876.649748:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739003136:0@lo:13: 00010000:00010000:0.0:1788845876.903435:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845877.927028:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788845878.413568:0:8446:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2a2c2030 20000000:00000080:2.0:1788845878.413586:0:8446:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a0c3d3f1800 uarg=0000000000000000 20000000:01000000:2.0:1788845878.413624:0:8446:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788845878.413626:0:8446:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788845878.413629:0:8446:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788845878.413633:0:8446:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788845878.413638:0:8446:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788845878.413650:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788845878.413652:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788845878.413867:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788845878.413870:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788845878.424762:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788845878.427952:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788845878.428029:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788845878.428248:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788845878.428265:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788845878.428268:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788845878.429583:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788845878.430133:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788845878.430440:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788845878.430494:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788845878.430519:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788845878.430521:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788845878.431535:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788845878.432137:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788845878.432411:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788845878.432468:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788845878.432482:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788845878.432484:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788845878.433268:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788845878.433763:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788845878.433804:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788845878.433835:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1788845878.433850:0:8446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788845878.433870:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.433888:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c02824600/0x1345bc80c773edfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773edf5 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.433896:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c01475000/0x1345bc80c773ee26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ee1f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.433902:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ee50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ee49 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.433908:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ee5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ee57 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.433915:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c01475600/0x1345bc80c773ee6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ee65 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.433921:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c00031200/0x1345bc80c773ee88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ee81 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.433928:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c02825600/0x1345bc80c773eeab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773eea4 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.433944:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c02824a00/0x1345bc80c773eec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc2 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.433950:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c00031600/0x1345bc80c773eec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc9 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.433958:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.433992:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c00031600/0x1345bc80c773eec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc9 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.434007:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c00031600/0x1345bc80c773eec7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc9 expref: 9 pid: 5838 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845878.434020:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739003264:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845878.434425:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c02824a00/0x1345bc80c773eec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc2 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.434435:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c02824a00/0x1345bc80c773eec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc2 expref: 9 pid: 5840 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845878.434445:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d660700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739003392:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845878.434479:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c02825600/0x1345bc80c773eeab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773eea4 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.434487:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c02825600/0x1345bc80c773eeab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773eea4 expref: 18 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845878.434507:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739003520:0@lo:104: 00000100:00100000:3.0:1788845878.434552:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845878.434594:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c00031200/0x1345bc80c773ee88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ee81 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.434603:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c00031200/0x1345bc80c773ee88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ee81 expref: 18 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845878.434611:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739003648:0@lo:104: 00000100:00100000:3.0:1788845878.434636:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845878.434656:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c01475600/0x1345bc80c773ee6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ee65 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.434664:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c01475600/0x1345bc80c773ee6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ee65 expref: 18 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845878.434672:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d660a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739003776:0@lo:104: 00010000:00010000:3.0:1788845878.434695:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ee5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ee57 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.434701:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ee5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ee57 expref: 18 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845878.434708:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739003904:0@lo:104: 00010000:00010000:3.0:1788845878.434727:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ee50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ee49 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.434734:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ee50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ee49 expref: 18 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845878.434747:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739004032:0@lo:104: 00010000:00010000:3.0:1788845878.434771:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c01475000/0x1345bc80c773ee26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ee1f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.434779:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c01475000/0x1345bc80c773ee26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ee1f expref: 18 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845878.434787:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d660000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739004160:0@lo:104: 00010000:00010000:3.0:1788845878.434809:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c02824600/0x1345bc80c773edfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773edf5 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845878.434817:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c02824600/0x1345bc80c773edfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773edf5 expref: 18 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845878.434824:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739004288:0@lo:104: 00000100:00100000:3.0:1788845878.434841:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1167d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788845878.434920:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788845878.434941:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845878.434967:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845878.434982:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845878.434990:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845878.435000:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845878.435008:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739003520 00000100:00100000:2.0:1788845878.435015:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739003520 00000100:00100000:2.0:1788845878.435048:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739003648 00000100:00100000:2.0:1788845878.435187:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739003648 00000100:00100000:2.0:1788845878.435205:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739003776 00000100:00100000:2.0:1788845878.435207:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739003776 00000100:00100000:2.0:1788845878.435215:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739003904 00000100:00100000:2.0:1788845878.435217:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739003904 00000100:00100000:2.0:1788845878.435232:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739004032 00000100:00100000:2.0:1788845878.435234:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739004032 00000100:00100000:2.0:1788845878.435240:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739004160 00000100:00100000:2.0:1788845878.435242:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739004160 00000100:00100000:2.0:1788845878.435250:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739004288 00000100:00100000:2.0:1788845878.435251:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739004288 00000100:00100000:2.0:1788845878.435264:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788845878.435271:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:8446:x1875740739003520:12345-0@lo:104: 00010000:00010000:2.0:1788845878.435359:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773eeab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.435485:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788845878.435491:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+9:8446:x1875740739003520:12345-0@lo:104: Request processed in 220us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.435498:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788845878.435515:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845878.435521:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d6a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+8:8446:x1875740739003648:12345-0@lo:104: 00010000:00010000:2.0:1788845878.435529:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ee88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.435574:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788845878.435579:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d6a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+8:8446:x1875740739003648:12345-0@lo:104: Request processed in 58us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.435585:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845878.435618:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845878.435625:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+7:8446:x1875740739003776:12345-0@lo:104: 00010000:00010000:2.0:1788845878.435633:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ee6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.435679:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788845878.435684:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+7:8446:x1875740739003776:12345-0@lo:104: Request processed in 61us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.435690:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845878.435703:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788845878.435708:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+6:8446:x1875740739003904:12345-0@lo:104: 00010000:00010000:2.0:1788845878.435715:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ee5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.435738:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788845878.435742:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+6:8446:x1875740739003904:12345-0@lo:104: Request processed in 35us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.435747:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788845878.435757:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788845878.435762:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:8446:x1875740739004032:12345-0@lo:104: 00010000:00010000:2.0:1788845878.435768:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ee50 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.435789:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788845878.435794:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:8446:x1875740739004032:12345-0@lo:104: Request processed in 33us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.435799:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788845878.435808:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788845878.435813:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+4:8446:x1875740739004160:12345-0@lo:104: 00010000:00010000:2.0:1788845878.435819:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ee26 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.435848:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788845878.435853:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+4:8446:x1875740739004160:12345-0@lo:104: Request processed in 40us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.435858:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788845878.435872:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788845878.435878:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:8446:x1875740739004288:12345-0@lo:104: 00010000:00010000:2.0:1788845878.435884:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773edfc expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.435908:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788845878.435913:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:8446:x1875740739004288:12345-0@lo:104: Request processed in 36us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.435918:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788845878.435939:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788845878.435944:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773eeab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.435952:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f56200 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788845878.435955:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773eeab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.435963:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773eeab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845878.435970:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773eeab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845878.435976:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845878.436014:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773eeab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436021:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845878.436037:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773eeab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436043:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56200/0x1345bc80c773eea4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773eeab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436071:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788845878.436075:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ee88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436081:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474200 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788845878.436083:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ee88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436090:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ee88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845878.436096:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ee88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845878.436101:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845878.436114:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436120:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845878.436125:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436141:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c773ee81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436170:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788845878.436174:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ee6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436179:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f56600 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788845878.436182:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ee6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436189:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ee6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845878.436194:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ee6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845878.436199:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845878.436212:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436217:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845878.436232:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436237:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56600/0x1345bc80c773ee65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436245:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788845878.436253:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ee5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436258:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030e00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788845878.436260:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ee5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436266:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ee5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845878.436272:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ee5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845878.436276:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845878.436820:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436829:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845878.436835:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436842:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c00030e00/0x1345bc80c773ee57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436852:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788845878.436855:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ee50 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436861:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030c00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788845878.436864:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ee50 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436882:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ee50 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845878.436889:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ee50 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845878.436894:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845878.436907:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee50 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436913:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845878.436917:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee50 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436923:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c00030c00/0x1345bc80c773ee49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee50 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436932:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788845878.436935:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ee26 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436940:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824800 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788845878.436942:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ee26 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436948:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ee26 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845878.436953:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ee26 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845878.436963:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845878.436976:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee26 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436981:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845878.436985:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee26 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436991:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ee1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee26 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.436999:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845878.437002:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773edfc expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.437008:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031000 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788845878.437010:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773edfc expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.437016:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773edfc expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845878.437022:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773edfc expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845878.437026:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845878.437036:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773edfc expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.437041:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845878.437184:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773edfc expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.437192:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c00031000/0x1345bc80c773edf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773edfc expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.437206:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845878.437208:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845878.437209:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845878.437217:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845878.437238:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739004416:0@lo:103: 00010000:00010000:0.0:1788845878.437404:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845878.437415:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739004672:0@lo:103: 00000100:00100000:0.0:1788845878.437445:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739004800:0@lo:103: 00000100:00100000:2.0:1788845878.437578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845878.437660:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739004928:0@lo:103: 00000100:00100000:2.0:1788845878.437681:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845878.438420:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739003520:0@lo:104: 00000100:00100000:3.0:1788845878.438431:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739003648:0@lo:104: 00000100:00100000:3.0:1788845878.438438:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d660a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739003776:0@lo:104: 00000100:00100000:3.0:1788845878.438446:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739003904:0@lo:104: 00000100:00100000:3.0:1788845878.438454:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739004032:0@lo:104: 00000100:00100000:3.0:1788845878.438461:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d660000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739004160:0@lo:104: 00000100:00100000:3.0:1788845878.438469:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739004288:0@lo:104: 00000100:00100000:3.0:1788845878.438624:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739004544:0@lo:103: 00000100:00100000:3.0:1788845878.439174:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845878.439387:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739004416 00000100:00100000:1.0:1788845878.439394:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739004416 00010000:00010000:1.0:1788845878.439428:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c02825600/0x1345bc80c773eeab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773eea4 expref: 19 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845878.439488:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739004928 00000100:00100000:0.0:1788845878.439492:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739004928 00010000:00010000:0.0:1788845878.439511:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ee50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ee49 expref: 20 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845878.439555:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845878.439564:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+20:3307:x1875740739004416:12345-0@lo:103: 00010000:00010000:0.0:1788845878.439577:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845878.439581:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c02825600/0x1345bc80c773eeab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773eea4 expref: 20 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.439592:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c02825600/0x1345bc80c773eeab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773eea4 expref: 20 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.439607:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02825600/0x1345bc80c773eeab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773eea4 expref: 20 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.439621:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845878.439663:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739004416:12345-0@lo:103: Request processed in 100us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845878.439670:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845878.439686:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788845878.439692:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:3307:x1875740739004928:12345-0@lo:103: 00010000:00010000:0.0:1788845878.439699:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845878.439704:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ee50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ee49 expref: 18 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.439711:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ee50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ee49 expref: 18 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.439732:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ee50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ee49 expref: 18 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.439741:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845878.439762:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:3307:x1875740739004928:12345-0@lo:103: Request processed in 71us (2080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845878.439768:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788845878.439804:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739004416:0@lo:103: 00000100:00100000:0.0:1788845878.439812:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739004928:0@lo:103: 00000100:00100000:0.0:1788845878.439950:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739004544 00000100:00100000:0.0:1788845878.439954:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739004544 00010000:00010000:0.0:1788845878.439970:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c00031200/0x1345bc80c773ee88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ee81 expref: 17 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845878.439988:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788845878.439994:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:3308:x1875740739004544:12345-0@lo:103: 00010000:00010000:0.0:1788845878.440002:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845878.440006:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c00031200/0x1345bc80c773ee88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ee81 expref: 17 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.440013:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c00031200/0x1345bc80c773ee88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ee81 expref: 17 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.440023:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c00031200/0x1345bc80c773ee88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ee81 expref: 17 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.440031:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845878.440269:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845878.440364:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739004800 00000100:00100000:1.0:1788845878.440369:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739004800 00010000:00010000:1.0:1788845878.440385:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ee5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ee57 expref: 17 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845878.440403:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788845878.440409:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:3310:x1875740739004800:12345-0@lo:103: 00010000:00010000:1.0:1788845878.440417:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845878.440420:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ee5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ee57 expref: 17 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845878.440429:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ee5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ee57 expref: 17 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845878.440446:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ee5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ee57 expref: 17 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845878.440455:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845878.440669:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:3310:x1875740739004800:12345-0@lo:103: Request processed in 259us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845878.440676:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788845878.440764:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739005056:0@lo:103: 00000100:00100000:3.0:1788845878.440797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845878.440880:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739004800:0@lo:103: 00000100:00100000:1.0:1788845878.440926:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739005056 00000100:00100000:1.0:1788845878.440930:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739005056 00010000:00010000:1.0:1788845878.440945:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c01475000/0x1345bc80c773ee26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ee1f expref: 16 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845878.440972:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788845878.440978:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:3308:x1875740739005056:12345-0@lo:103: 00010000:00010000:1.0:1788845878.440986:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845878.440990:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c01475000/0x1345bc80c773ee26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ee1f expref: 16 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845878.440998:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c01475000/0x1345bc80c773ee26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ee1f expref: 16 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845878.441009:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01475000/0x1345bc80c773ee26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ee1f expref: 16 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845878.441018:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845878.441305:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739005056:0@lo:103: 00000100:00100000:1.0:1788845878.441433:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:3308:x1875740739005056:12345-0@lo:103: Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845878.441440:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788845878.441612:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:3308:x1875740739004544:12345-0@lo:103: Request processed in 1616us (2437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845878.441619:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788845878.441642:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845878.441674:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739005184:0@lo:103: 00000100:00100000:0.0:1788845878.441700:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845878.441734:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739004672 00000100:00100000:0.0:1788845878.441739:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739004672 00010000:00010000:0.0:1788845878.441756:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c01475600/0x1345bc80c773ee6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ee65 expref: 14 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845878.441775:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739005184 00000100:00100000:0.0:1788845878.441778:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739005184 00010000:00010000:0.0:1788845878.441788:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c02824600/0x1345bc80c773edfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773edf5 expref: 15 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845878.441800:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788845878.441806:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:3309:x1875740739004672:12345-0@lo:103: 00010000:00010000:0.0:1788845878.441814:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845878.441817:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c01475600/0x1345bc80c773ee6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ee65 expref: 15 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.441824:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c01475600/0x1345bc80c773ee6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ee65 expref: 15 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.441836:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01475600/0x1345bc80c773ee6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ee65 expref: 15 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.441846:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845878.441875:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:3309:x1875740739004672:12345-0@lo:103: Request processed in 69us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845878.441891:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788845878.441904:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788845878.441910:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26394450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:3309:x1875740739005184:12345-0@lo:103: 00010000:00010000:0.0:1788845878.441917:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845878.441921:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c02824600/0x1345bc80c773edfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773edf5 expref: 13 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.441929:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c02824600/0x1345bc80c773edfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773edf5 expref: 13 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.441939:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02824600/0x1345bc80c773edfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773edf5 expref: 13 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.441947:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845878.441970:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26394450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:3309:x1875740739005184:12345-0@lo:103: Request processed in 60us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845878.441975:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788845878.442017:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739004672:0@lo:103: 00000100:00100000:0.0:1788845878.442025:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739005184:0@lo:103: 00000100:00100000:3.0:1788845878.442443:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739004544:0@lo:103: 00000100:00100000:1.0:1788845878.447517:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845878.447628:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739003264:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845878.447640:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d660700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875740739003392:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845878.447682:0:8446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845878.448270:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845878.452269:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720107648 00000100:00100000:2.0:1788845878.452293:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720107648 00010000:00010000:3.0:1788845878.452398:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c02824a00/0x1345bc80c773eec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc2 expref: 10 pid: 5840 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845878.452823:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720107520 00000100:00100000:0.0:1788845878.452830:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720107520 00010000:00010000:0.0:1788845878.452853:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c00031600/0x1345bc80c773eec7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc9 expref: 11 pid: 5838 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845878.452891:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:0.0:1788845878.452900:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a77a96b-0efb-4559-b734-596c51917804+11:2353:x1875740720107648:12345-192.168.206.48@tcp:103: 00010000:00010000:0.0:1788845878.452917:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845878.452938:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c02824a00/0x1345bc80c773eec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc2 expref: 11 pid: 5840 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.452950:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c02824a00/0x1345bc80c773eec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc2 expref: 11 pid: 5840 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.452968:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02824a00/0x1345bc80c773eec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc2 expref: 11 pid: 5840 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.452983:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845878.453044:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a77a96b-0efb-4559-b734-596c51917804+10:2353:x1875740720107648:12345-192.168.206.48@tcp:103: Request processed in 145us (5536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845878.453060:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:0.0:1788845878.453079:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:0.0:1788845878.453086:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a77a96b-0efb-4559-b734-596c51917804+9:2353:x1875740720107520:12345-192.168.206.48@tcp:103: 00010000:00010000:0.0:1788845878.453094:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845878.453098:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c00031600/0x1345bc80c773eec7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc9 expref: 9 pid: 5838 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.453107:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c00031600/0x1345bc80c773eec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc9 expref: 9 pid: 5838 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.453118:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c00031600/0x1345bc80c773eec7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbc9 expref: 9 pid: 5838 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.453129:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.453138:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.453190:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.453197:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.453203:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.453209:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.453215:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57200 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788845878.453219:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.453226:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.453243:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845878.453254:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845878.453276:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a77a96b-0efb-4559-b734-596c51917804+8:2353:x1875740720107520:12345-192.168.206.48@tcp:103: Request processed in 191us (5009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845878.453283:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00010000:00010000:2.0:1788845878.454622:0:8446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.454636:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.454642:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c12f57200/0x1345bc80c773eeff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845878.950670:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845879.718517:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3537ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739005312:0@lo:13: 00000100:00100000:2.0:1788845879.718597:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845879.718799:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739005312 00000100:00100000:1.0:1788845879.718808:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739005312 00000100:00100000:1.0:1788845879.718865:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788845879.718875:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739005312:12345-0@lo:13: 00002000:00000024:1.0:1788845879.718908:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845879.718952:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739005312:12345-0@lo:13: Request processed in 79us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845879.718960:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788845879.719027:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3537ca80 x1875740739005312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845879.719046:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3537ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739005312:0@lo:13: 00000100:00080000:3.0:1788845879.720459:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788845879.974447:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788845880.230355:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788845880.230363:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a0c2067c000 from 39 10000000:01000000:2.0:1788845880.230368:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788845880.230417:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.230430:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.230443:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845880.230465:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739005440:0@lo:101: 00000100:00100000:2.0:1788845880.230528:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845880.230596:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074aa000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845880.230717:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739005440 00000100:00100000:1.0:1788845880.230724:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739005440 00000100:00100000:1.0:1788845880.230777:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788845880.230786:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+12:5842:x1875740739005440:12345-0@lo:101: 00010000:00010000:1.0:1788845880.230801:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845880.230815:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ef0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ef06 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845880.230838:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ef0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ef06 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845880.230849:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ef0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ef06 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845880.230858:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475e00, rc 0) 00000100:00100000:1.0:1788845880.230920:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:5842:x1875740739005440:12345-0@lo:101: Request processed in 135us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845880.230926:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788845880.230971:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739005440:0@lo:101: 00010000:00010000:1.0:1788845880.231006:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845880.231014:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845880.231064:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3537ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739005568:0@lo:501: 00000100:00100000:1.0:1788845880.231089:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845880.231110:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06b98180 going to sleep for 11 seconds 00000100:00100000:3.0:1788845880.231307:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739005568 00000100:00100000:3.0:1788845880.231313:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739005568 00000100:00100000:3.0:1788845880.231353:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788845880.231361:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:5842:x1875740739005568:12345-0@lo:501: 00000100:00100000:3.0:1788845880.231619:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:5842:x1875740739005568:12345-0@lo:501: Request processed in 257us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845880.231626:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788845880.234836:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3537ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739005568:0@lo:501: 00000100:00100000:1.0:1788845880.234890:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3537ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739005696:0@lo:503: 00000100:00100000:1.0:1788845880.234952:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845880.234983:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739005696 00000100:00100000:1.0:1788845880.234986:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06b98180 going to sleep for 11 seconds 00000100:00100000:3.0:1788845880.234991:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739005696 00000100:00100000:3.0:1788845880.235044:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788845880.235053:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:5842:x1875740739005696:12345-0@lo:503: 00000100:00100000:3.0:1788845880.235872:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:5842:x1875740739005696:12345-0@lo:503: Request processed in 818us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845880.235889:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788845880.235936:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3537ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739005696:0@lo:503: 00000100:00100000:3.0:1788845880.236337:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d660700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8463:1875740739005824:0@lo:502: 00000100:00100000:3.0:1788845880.236375:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845880.236399:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c0972dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845880.236424:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739005824 00000100:00100000:3.0:1788845880.236428:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739005824 00000100:00100000:3.0:1788845880.236459:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788845880.236481:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:8463:x1875740739005824:12345-0@lo:502: 00000100:00100000:3.0:1788845880.236657:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:8463:x1875740739005824:12345-0@lo:502: Request processed in 190us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845880.236664:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788845880.236967:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d660700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8463:1875740739005824:0@lo:502: 00000100:00100000:1.0:1788845880.237012:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3537fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8463:1875740739005952:0@lo:502: 00000100:00100000:1.0:1788845880.237050:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845880.237064:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06b98480 going to sleep for 11 seconds 00000100:00100000:1.0:1788845880.237090:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739005952 00000100:00100000:1.0:1788845880.237094:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739005952 00000100:00100000:1.0:1788845880.237116:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788845880.237122:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:8463:x1875740739005952:12345-0@lo:502: 00000100:00100000:1.0:1788845880.237298:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:8463:x1875740739005952:12345-0@lo:502: Request processed in 175us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845880.237305:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788845880.237345:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3537fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8463:1875740739005952:0@lo:502: 00000040:00080000:1.0:1788845880.237371:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788845880.237483:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788845880.237504:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788845880.237513:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845880.237523:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845880.237543:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788845880.237546:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788845880.237548:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788845880.237570:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845880.237578:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845880.237586:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845880.237599:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3537fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739006080:0@lo:101: 00000100:00100000:1.0:1788845880.237626:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845880.237643:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06b98480 going to sleep for 11 seconds 00000100:00100000:1.0:1788845880.237657:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739006080 00000100:00100000:1.0:1788845880.237661:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739006080 00000100:00100000:1.0:1788845880.237685:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788845880.237692:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+13:5842:x1875740739006080:12345-0@lo:101: 00010000:00010000:1.0:1788845880.237700:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845880.237718:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475c00/0x1345bc80c773ef1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ef14 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845880.237738:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475c00/0x1345bc80c773ef1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ef14 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845880.237749:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475c00/0x1345bc80c773ef1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ef14 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845880.237758:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475c00, rc 0) 00000100:00100000:1.0:1788845880.237798:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:5842:x1875740739006080:12345-0@lo:101: Request processed in 106us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845880.237803:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788845880.237868:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3537fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739006080:0@lo:101: 00010000:00010000:3.0:1788845880.237880:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845880.237890:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845880.237930:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739006208:0@lo:501: 00000100:00100000:3.0:1788845880.237954:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845880.237982:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c203d2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788845880.238417:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739006208 00000100:00100000:1.0:1788845880.238422:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739006208 00000100:00100000:1.0:1788845880.238444:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788845880.238450:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:5842:x1875740739006208:12345-0@lo:501: 00000100:00100000:1.0:1788845880.238660:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:5842:x1875740739006208:12345-0@lo:501: Request processed in 209us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845880.238667:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788845880.239015:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739006208:0@lo:501: 00000100:00100000:3.0:1788845880.239047:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739006336:0@lo:503: 00000100:00100000:3.0:1788845880.239092:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845880.239124:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c203d2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788845880.239432:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739006336 00000100:00100000:1.0:1788845880.239437:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739006336 00000100:00100000:1.0:1788845880.239463:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788845880.239470:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:5842:x1875740739006336:12345-0@lo:503: 00000100:00100000:1.0:1788845880.239628:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:5842:x1875740739006336:12345-0@lo:503: Request processed in 158us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845880.239636:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788845880.240141:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739006336:0@lo:503: 00000100:00100000:3.0:1788845880.240557:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8464:1875740739006464:0@lo:502: 00000100:00100000:3.0:1788845880.240601:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845880.240627:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739006464 00000100:00100000:3.0:1788845880.240632:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739006464 00000100:00100000:3.0:1788845880.240661:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788845880.240668:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:8464:x1875740739006464:12345-0@lo:502: 00000100:00100000:3.0:1788845880.240822:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:8464:x1875740739006464:12345-0@lo:502: Request processed in 153us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845880.240830:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788845880.240871:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c203d2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788845880.240886:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8464:1875740739006464:0@lo:502: 00000020:01000000:3.0:1788845880.240907:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845880.240915:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845880.240917:0:8464:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788845880.240921:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788845880.240941:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8464:1875740739006592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845880.240973:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845880.240992:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739006592 00000100:00100000:3.0:1788845880.240996:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739006592 00000100:00100000:3.0:1788845880.241016:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788845880.241022:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:8464:x1875740739006592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845880.243701:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845880.245049:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:8464:x1875740739006592:12345-0@lo:502:llog_process_th.0 Request processed in 4020us (4069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845880.245061:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788845880.245165:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8464:1875740739006592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845880.245199:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845880.245207:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845880.245209:0:8464:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788845880.245214:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788845880.245281:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788845880.245301:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788845880.245312:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845880.245322:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845880.245331:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788845880.245333:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a0c3c96b800 from 39 10000000:01000000:3.0:1788845880.245336:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788845880.245363:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845880.245370:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845880.245378:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845880.245394:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739006720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788845880.245427:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845880.245452:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845880.245466:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739006720 00000100:00100000:3.0:1788845880.245471:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739006720 00000100:00100000:3.0:1788845880.245510:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788845880.245518:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:5842:x1875740739006720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845880.245530:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845880.245553:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c12f56400/0x1345bc80c773ef29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ef22 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845880.245573:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c12f56400/0x1345bc80c773ef29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ef22 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845880.245583:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c12f56400/0x1345bc80c773ef29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ef22 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845880.245591:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f56400, rc 0) 00000100:00100000:3.0:1788845880.245621:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740739006720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845880.245627:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788845880.245654:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739006720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845880.245665:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845880.245672:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845880.245711:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739006848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845880.245732:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845880.245744:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845880.245755:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739006848 00000100:00100000:3.0:1788845880.245758:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739006848 00000100:00100000:3.0:1788845880.245783:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788845880.245788:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740739006848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845880.245964:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740739006848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845880.245971:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788845880.245997:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739006848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845880.246020:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739006976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845880.246052:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845880.246065:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845880.246075:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739006976 00000100:00100000:3.0:1788845880.246078:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739006976 00000100:00100000:3.0:1788845880.246092:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788845880.246097:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740739006976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845880.246235:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740739006976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845880.246241:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788845880.246275:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739006976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845880.246513:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8465:1875740739007104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845880.246558:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845880.246575:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739007104 00000100:00100000:3.0:1788845880.246579:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739007104 00000100:00100000:3.0:1788845880.246598:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788845880.246604:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:8465:x1875740739007104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845880.246736:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:8465:x1875740739007104:12345-0@lo:502:llog_process_th.0 Request processed in 132us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845880.247343:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788845880.247391:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412540 going to sleep for 11 seconds 00000100:00100000:3.0:1788845880.247408:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8465:1875740739007104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845880.247452:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8465:1875740739007232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845880.247493:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845880.247510:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c203d2180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845880.247573:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739007232 00000100:00100000:0.0:1788845880.247578:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739007232 00000100:00100000:0.0:1788845880.247610:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788845880.247624:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:8465:x1875740739007232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845880.247777:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:8465:x1875740739007232:12345-0@lo:502:llog_process_th.0 Request processed in 154us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845880.247783:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788845880.249179:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8465:1875740739007232:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788845880.249217:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788845880.249464:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788845880.249481:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845880.249490:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845880.249501:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845880.249510:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788845880.249513:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788845880.249516:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788845880.249561:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845880.249569:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845880.249578:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845880.249605:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739007360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845880.249655:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845880.249695:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074f2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788845880.250405:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739007360 00000100:00100000:3.0:1788845880.250413:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739007360 00000100:00100000:3.0:1788845880.250450:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788845880.250459:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:5842:x1875740739007360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845880.250471:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845880.250484:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c12f56000/0x1345bc80c773ef37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ef30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845880.250507:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c12f56000/0x1345bc80c773ef37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ef30 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845880.250518:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c12f56000/0x1345bc80c773ef37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ef30 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845880.250526:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f56000, rc 0) 00000100:00100000:1.0:1788845880.250684:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739007360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845880.250712:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845880.250721:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845880.250773:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3537d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739007488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845880.250805:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845880.250827:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06b98840 going to sleep for 11 seconds 00000100:00100000:3.0:1788845880.250859:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740739007360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 400us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845880.250866:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788845880.250958:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739007488 00000100:00100000:3.0:1788845880.250962:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739007488 00000100:00100000:3.0:1788845880.250977:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788845880.250982:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740739007488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845880.251398:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740739007488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 413us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845880.251405:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788845880.256791:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3537d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739007488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845880.256848:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3537d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739007616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845880.257073:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845880.257180:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06b98840 going to sleep for 11 seconds 00000100:00100000:3.0:1788845880.257289:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739007616 00000100:00100000:3.0:1788845880.257296:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739007616 00000100:00100000:3.0:1788845880.257344:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788845880.257353:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740739007616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845880.257553:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740739007616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845880.257562:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788845880.257727:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3537d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739007616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.257924:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8466:1875740739007744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845880.257963:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845880.257988:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739007744 00000100:00100000:2.0:1788845880.257992:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739007744 00000100:00100000:3.0:1788845880.260257:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074aad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788845880.263144:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788845880.263174:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:8466:x1875740739007744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845880.263403:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:8466:x1875740739007744:12345-0@lo:502:llog_process_th.0 Request processed in 236us (5440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845880.263417:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788845880.263492:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8466:1875740739007744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845880.263524:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845880.263544:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845880.263546:0:8466:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788845880.263551:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788845880.263589:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8466:1875740739007872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845880.263627:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845880.263652:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074aad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788845880.263669:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739007872 00000100:00100000:2.0:1788845880.263675:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739007872 00000100:00100000:2.0:1788845880.263701:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788845880.263707:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:8466:x1875740739007872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845880.263813:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:8466:x1875740739007872:12345-0@lo:502:llog_process_th.0 Request processed in 105us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845880.263819:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788845880.263854:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8466:1875740739007872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845880.263872:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845880.263876:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845880.263878:0:8466:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788845880.263882:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788845880.263981:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788845880.264004:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788845880.264012:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.264022:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845880.264038:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788845880.264041:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a0c0942a000 from 39 10000000:01000000:2.0:1788845880.264044:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788845880.264065:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.264073:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.264080:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845880.264093:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739008000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.264120:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845880.264134:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c059fa780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845880.264145:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739008000 00000100:00100000:2.0:1788845880.264148:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739008000 00000100:00100000:2.0:1788845880.264187:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788845880.264193:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740739008000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845880.264202:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845880.264211:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c02824600/0x1345bc80c773ef45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ef3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.264230:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02824600/0x1345bc80c773ef45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ef3e expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.264240:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c02824600/0x1345bc80c773ef45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ef3e expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.264258:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02824600, rc 0) 00000100:00100000:2.0:1788845880.264285:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739008000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845880.264291:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788845880.264320:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739008000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845880.264330:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.264339:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845880.264376:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739008128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.264398:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845880.264409:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074aa780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845880.264420:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739008128 00000100:00100000:2.0:1788845880.264423:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739008128 00000100:00100000:2.0:1788845880.264443:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788845880.264448:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739008128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.264657:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739008128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845880.264663:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788845880.264691:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739008128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.264714:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739008256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.264748:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845880.264767:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074aa780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845880.264777:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739008256 00000100:00100000:2.0:1788845880.264780:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739008256 00000100:00100000:2.0:1788845880.264799:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788845880.264804:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739008256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.264936:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739008256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845880.264942:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788845880.264976:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739008256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.265117:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8467:1875740739008384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845880.265148:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845880.265185:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739008384 00000100:00100000:2.0:1788845880.265189:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739008384 00000100:00100000:2.0:1788845880.265209:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788845880.265215:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:8467:x1875740739008384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845880.265362:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:8467:x1875740739008384:12345-0@lo:502:llog_process_th.0 Request processed in 147us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845880.265369:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788845880.265396:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c08ec5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788845880.265409:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8467:1875740739008384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845880.265443:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8467:1875740739008512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845880.265471:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845880.265488:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739008512 00000100:00100000:2.0:1788845880.265492:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739008512 00000100:00100000:2.0:1788845880.265512:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788845880.265517:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:8467:x1875740739008512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845880.265642:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:8467:x1875740739008512:12345-0@lo:502:llog_process_th.0 Request processed in 124us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845880.265648:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788845880.265674:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c08ec5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788845880.265685:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8467:1875740739008512:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788845880.265702:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788845880.265737:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788845880.265749:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788845880.265756:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.265764:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845880.265773:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788845880.265775:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788845880.265777:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788845880.265794:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.265800:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.265808:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845880.265820:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739008640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.265845:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845880.265863:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074ea900 going to sleep for 11 seconds 00000100:00100000:2.0:1788845880.265874:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739008640 00000100:00100000:2.0:1788845880.265878:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739008640 00000100:00100000:2.0:1788845880.265897:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788845880.266904:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739008640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845880.266917:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845880.266930:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c02825c00/0x1345bc80c773ef53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ef4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.266951:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02825c00/0x1345bc80c773ef53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ef4c expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.266962:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c02825c00/0x1345bc80c773ef53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ef4c expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845880.266970:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02825c00, rc 0) 00000100:00100000:2.0:1788845880.267019:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739008640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845880.267026:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788845880.267433:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739008640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845880.267447:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845880.267457:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845880.267514:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3537dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739008768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845880.267553:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845880.267588:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06b98780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845880.267647:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739008768 00000100:00100000:2.0:1788845880.267652:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739008768 00000100:00100000:2.0:1788845880.267677:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788845880.267683:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739008768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.267873:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739008768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845880.267879:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788845880.267911:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3537dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739008768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.267935:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739008896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.267970:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845880.267981:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074ea900 going to sleep for 11 seconds 00000100:00100000:2.0:1788845880.267991:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739008896 00000100:00100000:2.0:1788845880.267994:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739008896 00000100:00100000:2.0:1788845880.268009:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788845880.268014:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739008896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.268141:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739008896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845880.268147:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788845880.268363:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739008896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845880.268501:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8468:1875740739009024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845880.268544:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845880.268613:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739009024 00000100:00100000:2.0:1788845880.268617:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739009024 00000100:00100000:2.0:1788845880.268638:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788845880.268644:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:8468:x1875740739009024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845880.268776:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:8468:x1875740739009024:12345-0@lo:502:llog_process_th.0 Request processed in 131us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845880.268782:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788845880.268807:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074ea900 going to sleep for 11 seconds 00000100:00100000:2.0:1788845880.268816:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8468:1875740739009024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845880.268834:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845880.268841:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845880.268843:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788845880.268848:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788845880.268862:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8468:1875740739009152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845880.268895:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845880.268911:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739009152 00000100:00100000:2.0:1788845880.268914:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739009152 00000100:00100000:2.0:1788845880.268930:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788845880.268935:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:8468:x1875740739009152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845880.269033:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:8468:x1875740739009152:12345-0@lo:502:llog_process_th.0 Request processed in 97us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845880.269039:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788845880.269062:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c0771f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788845880.269071:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8468:1875740739009152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845880.270311:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845880.270322:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845880.270325:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788845880.270329:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788845880.270597:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788845880.270618:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788845880.270635:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845880.270645:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845880.270654:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788845880.270656:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a0c088c4d28 from 1 10000000:01000000:0.0:1788845880.270658:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788845880.270686:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c773ef5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845880.270693:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c773ef5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845880.270702:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c773ef5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845880.270721:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739009280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845880.270770:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845880.270803:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074f2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845880.270822:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739009280 00000100:00100000:0.0:1788845880.270828:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739009280 00000100:00100000:0.0:1788845880.270866:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788845880.270875:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739009280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845880.270885:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845880.270896:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c3ebcf600/0x1345bc80c773ef61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ef5a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845880.270917:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3ebcf600/0x1345bc80c773ef61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ef5a expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845880.270935:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c3ebcf600/0x1345bc80c773ef61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ef5a expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845880.270944:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcf600, rc 0) 00000100:00100000:0.0:1788845880.270976:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739009280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845880.270982:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788845880.271029:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739009280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845880.271039:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c773ef5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef61 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845880.271048:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c773ef5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef61 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845880.271355:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739009408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845880.271379:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845880.271391:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074f2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845880.271403:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739009408 00000100:00100000:0.0:1788845880.271407:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739009408 00000100:00100000:0.0:1788845880.271425:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788845880.271430:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739009408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845880.271954:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739009408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 522us (573us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788845880.271962:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788845880.272000:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739009408:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788845880.272030:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788845880.272037:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c773ef5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef61 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845880.272045:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c773ef5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef61 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845880.998403:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845881.247444:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845881.247479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845881.247508:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845881.247560:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845881.247628:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720108160 00000100:00100000:0.0:1788845881.247638:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720108160 00000100:00100000:3.0:1788845881.247645:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720107904 00000100:00100000:3.0:1788845881.247649:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720107904 00000100:00100000:0.0:1788845881.247707:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720108032 00000100:00100000:0.0:1788845881.247711:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720108032 00000100:00100000:3.0:1788845881.247712:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1788845881.247720:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2351:x1875740720107904:12345-192.168.206.48@tcp:400: 00000100:00100000:0.0:1788845881.247731:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1788845881.247737:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+5:2351:x1875740720108160:12345-192.168.206.48@tcp:400: 00000100:00100000:3.0:1788845881.247787:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2351:x1875740720107904:12345-192.168.206.48@tcp:400: Request processed in 67us (350us total) trans 0 rc 0/0 00000100:00080000:1.0:1788845881.247791:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845881.247795:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00080000:1.0:1788845881.247795:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788845881.247797:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788845881.247816:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1788845881.247822:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+5:2351:x1875740720108032:12345-192.168.206.48@tcp:400: 00000100:00100000:2.0:1788845881.248122:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720107776 00000100:00100000:2.0:1788845881.248127:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720107776 00000100:00100000:2.0:1788845881.248184:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 162 00000100:00100000:2.0:1788845881.248192:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+8:2351:x1875740720107776:12345-192.168.206.48@tcp:400: 00000100:00100000:0.0:1788845881.248306:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+5:2351:x1875740720108160:12345-192.168.206.48@tcp:400: Request processed in 567us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845881.248314:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:3.0:1788845881.248345:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+5:2351:x1875740720108032:12345-192.168.206.48@tcp:400: Request processed in 522us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845881.248366:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:2.0:1788845881.249349:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+8:2351:x1875740720107776:12345-192.168.206.48@tcp:400: Request processed in 1153us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845881.249358:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 162 00000100:00100000:1.0:1788845881.308601:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845881.308697:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720108288 00000100:00100000:0.0:1788845881.308707:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720108288 00000100:00100000:0.0:1788845881.308764:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 163 00000100:00100000:0.0:1788845881.308783:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+8:5591:x1875740720108288:12345-192.168.206.48@tcp:101: 00010000:00010000:0.0:1788845881.308800:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845881.308817:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c3ebcf200/0x1345bc80c773ef68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cc2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845881.308845:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3ebcf200/0x1345bc80c773ef68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc2b expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845881.308874:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c3ebcf200/0x1345bc80c773ef68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc2b expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845881.308884:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcf200, rc 0) 00000100:00100000:0.0:1788845881.308940:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+9:5591:x1875740720108288:12345-192.168.206.48@tcp:101: Request processed in 167us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845881.308948:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 163 00000100:00100000:1.0:1788845881.313953:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845881.314072:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720108416 00000100:00100000:2.0:1788845881.314083:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720108416 00000100:00100000:2.0:1788845881.314142:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 164 00000100:00100000:2.0:1788845881.314180:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+9:5591:x1875740720108416:12345-192.168.206.48@tcp:501: 00000100:00100000:2.0:1788845881.314505:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+9:5591:x1875740720108416:12345-192.168.206.48@tcp:501: Request processed in 353us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845881.314521:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 164 00000100:00100000:1.0:1788845881.317670:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845881.324602:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720108544 00000100:00100000:2.0:1788845881.324616:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720108544 00000100:00100000:2.0:1788845881.324690:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 165 00000100:00100000:2.0:1788845881.324700:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+9:5591:x1875740720108544:12345-192.168.206.48@tcp:503: 00000100:00100000:2.0:1788845881.325695:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+9:5591:x1875740720108544:12345-192.168.206.48@tcp:503: Request processed in 991us (8028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845881.325705:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 165 00000100:00100000:1.0:1788845881.330807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845881.331414:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720108672 00000100:00100000:0.0:1788845881.331424:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720108672 00000100:00100000:0.0:1788845881.331676:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 166 00000100:00100000:0.0:1788845881.331688:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+9:6067:x1875740720108672:12345-192.168.206.48@tcp:502: 00000100:00100000:0.0:1788845881.332117:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+9:6067:x1875740720108672:12345-192.168.206.48@tcp:502: Request processed in 429us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845881.332125:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 166 00000100:00100000:1.0:1788845881.335614:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845881.335747:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720108800 00000100:00100000:2.0:1788845881.335756:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720108800 00000100:00100000:2.0:1788845881.335812:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 167 00000100:00100000:2.0:1788845881.335983:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+9:6067:x1875740720108800:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788845881.336412:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+9:6067:x1875740720108800:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 590us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845881.336421:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 167 00000100:00100000:1.0:1788845881.339726:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845881.340006:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720108928 00000100:00100000:0.0:1788845881.340015:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720108928 00000100:00100000:0.0:1788845881.340122:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 168 00000100:00100000:0.0:1788845881.340132:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+9:5591:x1875740720108928:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845881.340147:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845881.340187:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c3ebcf000/0x1345bc80c773ef6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cc32 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845881.340214:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3ebcf000/0x1345bc80c773ef6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc32 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845881.340224:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c3ebcf000/0x1345bc80c773ef6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc32 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845881.340245:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcf000, rc 0) 00000100:00100000:0.0:1788845881.340299:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:5591:x1875740720108928:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 169us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845881.340306:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 168 00000100:00100000:1.0:1788845881.341897:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845881.342506:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720109056 00000100:00100000:2.0:1788845881.342515:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720109056 00000100:00100000:2.0:1788845881.342574:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 169 00000100:00100000:2.0:1788845881.342584:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:5591:x1875740720109056:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845881.342845:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:5591:x1875740720109056:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 261us (954us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788845881.342853:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 169 00000100:00100000:2.0:1788845881.766776:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739009536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845881.766841:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845881.767521:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739009536 00000100:00100000:1.0:1788845881.767541:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739009536 00000100:00100000:1.0:1788845881.767624:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788845881.767635:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739009536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845881.767669:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845881.767722:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739009536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845881.767729:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788845881.767850:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788845881.767928:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3da26300 x1875740739009536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845881.767946:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739009536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845881.768145:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740739009920:0@lo:400:kworker.0 00000100:00100000:2.0:1788845881.768216:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845881.768237:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845881.768242:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739009792:0@lo:400:kworker.0 00000100:00100000:2.0:1788845881.768262:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845881.768291:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739010048:0@lo:400:kworker.0 00000100:00100000:2.0:1788845881.768312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845881.768333:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788845881.768338:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739009664:0@lo:400:kworker.0 00000100:00100000:2.0:1788845881.768361:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845881.768379:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739010176:0@lo:400:kworker.0 00000100:00100000:2.0:1788845881.768395:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845881.768414:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739009664 00000100:00100000:2.0:1788845881.768417:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739009664 00000100:00100000:2.0:1788845881.768442:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788845881.768448:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739009664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845881.768480:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739009664:12345-0@lo:400:kworker.0 Request processed in 32us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845881.768486:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788845881.768517:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739009664:0@lo:400:kworker.0 00000100:00100000:3.0:1788845881.768656:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739009920 00000100:00100000:3.0:1788845881.768660:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739009920 00000100:00100000:3.0:1788845881.768699:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739009792 00000100:00100000:3.0:1788845881.768702:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739009792 00000100:00100000:3.0:1788845881.768712:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739010176 00000100:00100000:3.0:1788845881.768713:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739010176 00000100:00100000:3.0:1788845881.768726:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788845881.768731:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740739009920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845881.768770:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740739009920:12345-0@lo:400:kworker.0 Request processed in 39us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845881.768776:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788845881.768787:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788845881.768792:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739009792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845881.768830:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739009792:12345-0@lo:400:kworker.0 Request processed in 38us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845881.768835:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788845881.768845:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788845881.768850:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739010176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845881.768875:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739010176:12345-0@lo:400:kworker.0 Request processed in 25us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845881.768880:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788845881.768907:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739009792:0@lo:400:kworker.0 00000100:00100000:3.0:1788845881.768917:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740739009920:0@lo:400:kworker.0 00000100:00100000:0.0:1788845881.769502:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739010048 00000100:00100000:0.0:1788845881.769509:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739010048 00000100:00100000:0.0:1788845881.769563:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788845881.769570:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739010048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845881.769611:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739010048:12345-0@lo:400:kworker.0 Request processed in 42us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845881.769616:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788845881.769727:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788845881.769732:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845881.769763:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739010176:0@lo:400:kworker.0 00010000:00080000:2.0:1788845881.769775:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3da27800 x1875740739010048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845881.769784:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739010048:0@lo:400:kworker.0 00010000:00010000:2.0:1788845882.025365:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788845882.481660:0:8505:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7959e140 20000000:00000080:2.0:1788845882.481675:0:8505:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a0c3d3f3c00 uarg=0000000000000000 20000000:01000000:2.0:1788845882.481708:0:8505:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788845882.481713:0:8505:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788845882.481718:0:8505:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788845882.482518:0:8506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788845882.482659:0:8505:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788845882.486570:0:8505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788845882.486630:0:8505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788845882.486690:0:8505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788845882.486710:0:8505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788845882.486728:0:8505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.486745:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c00030600/0x1345bc80c773ed4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed46 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.486752:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c00030000/0x1345bc80c773eda1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ed9a expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.486759:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ee18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ee11 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.486767:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c12f57600/0x1345bc80c773eed5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbfa expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.486788:0:8505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.486825:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c12f57600/0x1345bc80c773eed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbfa expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.486838:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c12f57600/0x1345bc80c773eed5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbfa expref: 9 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845882.486852:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875740739010304:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845882.486952:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ee18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ee11 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.486970:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ee18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ee11 expref: 18 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845882.486980:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875740739010432:0@lo:104: 00000100:00100000:3.0:1788845882.487017:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845882.487897:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739010432 00000100:00100000:2.0:1788845882.487906:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739010432 00000100:00100000:2.0:1788845882.487961:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788845882.487971:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:8505:x1875740739010432:12345-0@lo:104: 00010000:00010000:2.0:1788845882.487986:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ee18 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.489984:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c00030000/0x1345bc80c773eda1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ed9a expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.490000:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c00030000/0x1345bc80c773eda1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ed9a expref: 18 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845882.490012:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875740739010560:0@lo:104: 00000100:00100000:1.0:1788845882.490478:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845882.490564:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720109184 00000100:00100000:0.0:1788845882.490572:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720109184 00010000:00010000:0.0:1788845882.490603:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c12f57600/0x1345bc80c773eed5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbfa expref: 10 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845882.490643:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1788845882.490652:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a77a96b-0efb-4559-b734-596c51917804+10:2353:x1875740720109184:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845882.490665:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845882.490670:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c12f57600/0x1345bc80c773eed5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbfa expref: 10 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.490682:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c12f57600/0x1345bc80c773eed5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbfa expref: 10 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.490701:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845882.490757:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a77a96b-0efb-4559-b734-596c51917804+10:2353:x1875740720109184:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 104us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845882.490764:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:3.0:1788845882.491818:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845882.491887:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c00030600/0x1345bc80c773ed4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ed46 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.491900:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c00030600/0x1345bc80c773ed4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ed46 expref: 18 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845882.491911:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875740739010688:0@lo:104: 00000100:00100000:3.0:1788845882.491944:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788845882.491966:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c12f57600/0x1345bc80c773eed5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbfa expref: 9 pid: 5838 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845882.491979:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875740739010304:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788845882.492223:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788845882.492244:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845882.492255:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788845882.492261:0:5828:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788845882.492537:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739010560 00000100:00100000:3.0:1788845882.492543:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739010560 00000100:00100000:3.0:1788845882.492578:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788845882.492591:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739010688 00000100:00100000:3.0:1788845882.492594:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739010688 00000100:00100000:1.0:1788845882.492740:0:8507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788845882.492748:0:8507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d3f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:8505:x1875740739010560:12345-0@lo:104: 00010000:00010000:1.0:1788845882.492762:0:8507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773eda1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845882.492852:0:8507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788845882.492858:0:8507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d3f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:8505:x1875740739010560:12345-0@lo:104: Request processed in 111us (2792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845882.492865:0:8507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788845882.492883:0:8507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788845882.492890:0:8507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+4:8505:x1875740739010688:12345-0@lo:104: 00010000:00010000:1.0:1788845882.492897:0:8507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c02825000/0x1345bc80c773ed46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ed4d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845882.492928:0:8507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788845882.492933:0:8507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+4:8505:x1875740739010688:12345-0@lo:104: Request processed in 45us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845882.492939:0:8507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788845882.493048:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788845882.493055:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773eda1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493063:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825400 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:0.0:1788845882.493077:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773eda1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493086:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773eda1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845882.493093:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773eda1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845882.493099:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788845882.493141:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773eda1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493147:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845882.493187:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773eda1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493194:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c02825400/0x1345bc80c773ed9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773eda1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493206:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845882.493209:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c02825000/0x1345bc80c773ed46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ed4d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493225:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825000 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:0.0:1788845882.493229:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02825000/0x1345bc80c773ed46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ed4d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493235:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c02825000/0x1345bc80c773ed46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ed4d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845882.493240:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02825000/0x1345bc80c773ed46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ed4d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845882.493245:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788845882.493260:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c02825000/0x1345bc80c773ed46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed4d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493266:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845882.493272:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c02825000/0x1345bc80c773ed46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed4d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493277:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c02825000/0x1345bc80c773ed46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ed4d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493286:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845882.493288:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845882.493290:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845882.493297:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845882.493309:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739010816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845882.493342:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845882.493373:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845882.493379:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739010944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845882.493421:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845882.493453:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739010816 00000100:00100000:0.0:1788845882.493458:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739010816 00010000:00010000:0.0:1788845882.493477:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c00030000/0x1345bc80c773eda1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ed9a expref: 19 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845882.493496:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739010944 00000100:00100000:0.0:1788845882.493499:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739010944 00010000:00010000:0.0:1788845882.493509:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c00030600/0x1345bc80c773ed4d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ed46 expref: 20 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845882.493540:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788845882.493547:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+20:3309:x1875740739010816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845882.493568:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845882.493574:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c00030000/0x1345bc80c773eda1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ed9a expref: 20 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493583:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c00030000/0x1345bc80c773eda1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ed9a expref: 20 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493598:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845882.493628:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+20:3309:x1875740739010816:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845882.493635:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788845882.493648:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788845882.493655:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739010944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845882.493663:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845882.493667:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c00030600/0x1345bc80c773ed4d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ed46 expref: 19 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493686:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c00030600/0x1345bc80c773ed4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ed46 expref: 19 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.493696:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845882.493720:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739010944:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845882.493726:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788845882.493763:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739010944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845882.493787:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739010816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845882.494435:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c00030000/0x1345bc80c773eda1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ed9a expref: 18 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845882.494448:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875740739010560:0@lo:104: 00010000:00010000:3.0:1788845882.494460:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c00030600/0x1345bc80c773ed4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ed46 expref: 17 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845882.494468:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875740739010688:0@lo:104: 00010000:00010000:2.0:1788845882.494692:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788845882.494700:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:8505:x1875740739010432:12345-0@lo:104: Request processed in 6730us (7682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845882.494708:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788845882.495673:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845882.495682:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ee18 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.495693:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825e00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:0.0:1788845882.495697:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ee18 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.495707:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ee18 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845882.495714:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ee18 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845882.495720:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788845882.495764:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee18 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.495781:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845882.495813:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee18 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.495820:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c02825e00/0x1345bc80c773ee11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ee18 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.495836:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845882.495838:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845882.495840:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845882.495847:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845882.495862:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739011072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845882.495910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845882.495955:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739011072 00000100:00100000:0.0:1788845882.495962:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739011072 00010000:00010000:0.0:1788845882.495984:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ee18 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ee11 expref: 17 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845882.496012:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788845882.496020:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:3308:x1875740739011072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845882.496031:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845882.496036:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ee18 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ee11 expref: 17 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.496046:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ee18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ee11 expref: 17 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.496062:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.496201:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.496221:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.496228:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.496235:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.496242:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.496247:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788845882.496251:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.496258:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.496267:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845882.496276:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845882.496310:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:3308:x1875740739011072:12345-0@lo:103:ldlm_bl.0 Request processed in 291us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845882.496318:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788845882.496354:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739011072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845882.496670:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c00030400/0x1345bc80c773ee18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ee11 expref: 16 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845882.496682:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1875740739010432:0@lo:104: 00010000:00010000:3.0:1788845882.496706:0:8505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.496716:0:8505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.496721:0:8505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845882.496727:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef76 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.046282:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845883.361232:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845883.361898:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720109312 00000100:00100000:3.0:1788845883.361908:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720109312 00000100:00100000:3.0:1788845883.362093:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 171 00000100:00100000:3.0:1788845883.362103:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+9:5591:x1875740720109312:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845883.362138:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845883.362178:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cc39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845883.362205:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc39 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845883.362216:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc39 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845883.362226:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f57400, rc 0) 00000100:00100000:3.0:1788845883.362280:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+10:5591:x1875740720109312:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 179us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845883.362288:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 171 00000100:00100000:1.0:1788845883.367881:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845883.368421:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720109440 00000100:00100000:2.0:1788845883.368432:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720109440 00000100:00100000:2.0:1788845883.368564:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 172 00000100:00100000:2.0:1788845883.368577:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:5591:x1875740720109440:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845883.368826:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:5591:x1875740720109440:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 251us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.371447:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 172 00000100:00100000:2.0:1788845883.373482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845883.373551:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720109568 00000100:00100000:3.0:1788845883.373560:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720109568 00000100:00100000:3.0:1788845883.373608:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 173 00000100:00100000:3.0:1788845883.373617:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+10:5591:x1875740720109568:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845883.373817:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+10:5591:x1875740720109568:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 199us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845883.373825:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 173 00000100:00100000:1.0:1788845883.381272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845883.381420:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720109696 00000100:00100000:0.0:1788845883.381441:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720109696 00000100:00100000:0.0:1788845883.381494:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 174 00000100:00100000:0.0:1788845883.381504:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:6124:x1875740720109696:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788845883.381738:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:6124:x1875740720109696:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 234us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845883.381745:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 174 00000100:00100000:2.0:1788845883.394821:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845883.394906:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720109824 00000100:00100000:0.0:1788845883.394917:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720109824 00000100:00100000:0.0:1788845883.394971:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 175 00000100:00100000:0.0:1788845883.394981:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:6124:x1875740720109824:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788845883.395251:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:6124:x1875740720109824:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 270us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845883.395261:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 175 10000000:01000000:0.0:1788845883.887246:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788845883.887253:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c2067c000 from 4 10000000:01000000:0.0:1788845883.887258:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845883.887300:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.887312:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.887323:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845883.887347:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739011200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845883.887411:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845883.887459:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845883.887492:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739011200 00000100:00100000:0.0:1788845883.887500:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739011200 00000100:00100000:0.0:1788845883.887567:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788845883.887575:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740739011200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845883.887590:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845883.887602:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c773ef8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ef84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.887625:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c773ef8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ef84 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.887635:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c773ef8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ef84 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.887644:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce600, rc 0) 00000100:00100000:0.0:1788845883.887683:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739011200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845883.887689:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788845883.887732:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739011200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845883.887745:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.887754:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845883.887802:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739011328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845883.887826:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845883.887839:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845883.887857:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739011328 00000100:00100000:0.0:1788845883.887860:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739011328 00000100:00100000:0.0:1788845883.891304:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788845883.891322:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739011328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845883.891612:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739011328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (3783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845883.891621:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788845883.891683:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739011328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845883.891730:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739011456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845883.891774:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845883.891812:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731780 going to sleep for 11 seconds 00000100:00100000:3.0:1788845883.891915:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739011456 00000100:00100000:3.0:1788845883.891922:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739011456 00000100:00100000:3.0:1788845883.891960:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788845883.891968:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739011456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845883.892413:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739011456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 444us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845883.892916:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788845883.894168:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739011456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845883.896386:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8571:1875740739011584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845883.896481:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845883.896534:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845883.897044:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739011584 00000100:00100000:0.0:1788845883.897052:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739011584 00000100:00100000:0.0:1788845883.897111:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788845883.897120:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:8571:x1875740739011584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845883.897351:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:8571:x1875740739011584:12345-0@lo:502:llog_process_th.0 Request processed in 231us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845883.897359:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788845883.897472:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8571:1875740739011584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845883.897505:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845883.897525:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845883.897528:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788845883.897535:0:8571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a0c2067c000 00000020:00000080:3.0:1788845883.897538:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788845883.897625:0:8571:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8571:1875740739011712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845883.897796:0:8571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845883.897813:0:8571:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845883.905277:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739011712 00000100:00100000:0.0:1788845883.905290:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739011712 00000100:00100000:0.0:1788845883.905357:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788845883.905368:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:8571:x1875740739011712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845883.905622:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:8571:x1875740739011712:12345-0@lo:502:llog_process_th.0 Request processed in 255us (7824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845883.905639:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788845883.905707:0:8571:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8571:1875740739011712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788845883.905743:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845883.905750:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845883.905752:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788845883.905756:0:8571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788845883.905811:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788845883.905826:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845883.905835:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.905846:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845883.905856:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788845883.905858:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c3c96b800 from 4 10000000:01000000:0.0:1788845883.905861:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845883.910744:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.910763:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.910774:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845883.910798:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739011840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845883.911347:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845883.911387:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731600 going to sleep for 11 seconds 00000100:00100000:1.0:1788845883.913013:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739011840 00000100:00100000:1.0:1788845883.913024:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739011840 00000100:00100000:1.0:1788845883.913083:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788845883.913094:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739011840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845883.913108:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845883.913124:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773ef99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ef92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845883.913149:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773ef99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ef92 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845883.913193:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773ef99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ef92 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845883.913202:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474a00, rc 0) 00000100:00100000:1.0:1788845883.913264:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739011840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845883.913271:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788845883.921047:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739011840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845883.921081:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.921094:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845883.921184:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739011968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845883.921241:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845883.921280:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731600 going to sleep for 11 seconds 00000100:00100000:0.0:1788845883.921297:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739011968 00000100:00100000:0.0:1788845883.921303:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739011968 00000100:00100000:0.0:1788845883.921353:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788845883.921362:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739011968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845883.921618:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739011968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845883.921626:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788845883.921664:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739011968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845883.921691:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739012096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845883.921727:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845883.921740:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731600 going to sleep for 11 seconds 00000100:00100000:0.0:1788845883.921752:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739012096 00000100:00100000:0.0:1788845883.921755:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739012096 00000100:00100000:0.0:1788845883.921785:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788845883.921792:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739012096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845883.921934:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739012096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845883.921947:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788845883.921985:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739012096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845883.926342:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8575:1875740739012224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845883.926429:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845883.926467:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c364126c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845883.927914:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739012224 00000100:00100000:0.0:1788845883.927926:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739012224 00000100:00100000:0.0:1788845883.927976:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788845883.927987:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:8575:x1875740739012224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845883.928787:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:8575:x1875740739012224:12345-0@lo:502:llog_process_th.0 Request processed in 799us (2367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845883.928797:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788845883.930483:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8575:1875740739012224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845883.930540:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845883.930550:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845883.930552:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788845883.930559:0:8575:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a0c3c96b800 00000020:00000080:2.0:1788845883.930561:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788845883.930974:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8575:1875740739012352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845883.931037:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845883.931101:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739012352 00000100:00100000:3.0:1788845883.931108:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739012352 00000100:00100000:3.0:1788845883.931175:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788845883.931196:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:8575:x1875740739012352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845883.931400:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:8575:x1875740739012352:12345-0@lo:502:llog_process_th.0 Request processed in 206us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845883.931410:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788845883.931560:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b2f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788845883.931584:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8575:1875740739012352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845883.931604:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845883.931610:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845883.931611:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788845883.931615:0:8575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788845883.931730:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788845883.931748:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845883.931758:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845883.931776:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845883.931786:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788845883.931789:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c0942a000 from 4 10000000:01000000:3.0:1788845883.931791:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788845883.931815:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845883.931823:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845883.931842:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845883.931858:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739012480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788845883.931887:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845883.932031:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845883.933748:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739012480 00000100:00100000:0.0:1788845883.933759:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739012480 00000100:00100000:0.0:1788845883.933814:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788845883.933823:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739012480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845883.933839:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845883.933855:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773efa7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773efa0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.933999:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773efa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773efa0 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.934013:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773efa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773efa0 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845883.934022:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce000, rc 0) 00000100:00100000:0.0:1788845883.934091:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739012480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 269us (2202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845883.934107:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788845883.934194:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739012480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845883.934210:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773efa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845883.934219:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773efa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845883.934291:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739012608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845883.934327:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845883.934361:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b2f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788845883.934436:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739012608 00000100:00100000:2.0:1788845883.934527:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739012608 00000100:00100000:2.0:1788845883.934619:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788845883.934627:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739012608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845883.934831:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739012608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.934839:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788845883.934868:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739012608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845883.935022:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739012736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845883.935061:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845883.935173:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b2f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788845883.935269:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739012736 00000100:00100000:1.0:1788845883.935275:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739012736 00000100:00100000:1.0:1788845883.935312:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788845883.935320:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739012736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845883.935560:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739012736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845883.935568:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788845883.938418:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739012736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845883.938881:0:8577:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8577:1875740739012864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845883.938948:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845883.938981:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739012864 00000100:00100000:2.0:1788845883.938987:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739012864 00000100:00100000:2.0:1788845883.939027:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788845883.939036:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:8577:x1875740739012864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845883.939324:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:8577:x1875740739012864:12345-0@lo:502:llog_process_th.0 Request processed in 288us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.939332:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788845883.939384:0:8577:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b2f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788845883.939402:0:8577:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8577:1875740739012864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845883.939423:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845883.939435:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845883.939522:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788845883.939530:0:8577:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a0c0942a000 00000020:00000080:2.0:1788845883.939534:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788845883.939896:0:8577:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8577:1875740739012992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845883.939933:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845883.940008:0:8577:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b2f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845883.940043:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739012992 00000100:00100000:1.0:1788845883.940049:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739012992 00000100:00100000:1.0:1788845883.940232:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788845883.940241:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:8577:x1875740739012992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845883.940417:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:8577:x1875740739012992:12345-0@lo:502:llog_process_th.0 Request processed in 176us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845883.940424:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788845883.940578:0:8577:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:8577:1875740739012992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845883.940600:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845883.940606:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845883.940608:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788845883.940613:0:8577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788845883.940666:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788845883.940680:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845883.940689:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773efa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845883.940700:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773efa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845884.075344:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845884.838859:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845884.838890:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3537d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739013120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845884.838954:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845884.839188:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739013120 00000100:00100000:1.0:1788845884.839197:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739013120 00000100:00100000:1.0:1788845884.839257:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788845884.839267:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739013120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845884.839299:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845884.839360:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739013120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845884.839368:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788845884.839407:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3537d180 x1875740739013120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845884.839425:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3537d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739013120:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788845884.839496:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788845885.094695:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845886.118390:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845886.364526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845886.364627:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720110080 00000100:00100000:2.0:1788845886.364638:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720110080 00000100:00100000:2.0:1788845886.364714:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:2.0:1788845886.364726:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2351:x1875740720110080:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845886.364740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845886.364772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845886.364821:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2351:x1875740720110080:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 97us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845886.364829:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00080000:0.0:1788845886.364829:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845886.364856:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720109952 00000100:00100000:2.0:1788845886.364860:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720109952 00000100:00100000:2.0:1788845886.364896:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 191 00000100:00100000:3.0:1788845886.364901:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845886.364909:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:2352:x1875740720109952:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845886.364939:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:2352:x1875740720109952:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 34us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845886.364946:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 191 00000100:00100000:0.0:1788845886.366221:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720110336 00000100:00100000:0.0:1788845886.366230:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720110336 00000100:00100000:3.0:1788845886.366233:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720110208 00000100:00100000:3.0:1788845886.366240:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720110208 00000100:00100000:0.0:1788845886.366279:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:0.0:1788845886.366289:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2351:x1875740720110336:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845886.366303:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:3.0:1788845886.366314:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720110208:12345-192.168.206.48@tcp:400:kworker.0 00000100:00080000:2.0:1788845886.366316:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788845886.366322:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845886.366349:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2351:x1875740720110336:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 62us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845886.366357:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720110208:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 45us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845886.366359:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1788845886.366375:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:3.0:1788845886.886945:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739013504:0@lo:400:kworker.0 00000100:00100000:3.0:1788845886.887007:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845886.887061:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845886.887068:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739013632:0@lo:400:kworker.0 00000100:00100000:3.0:1788845886.887090:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845886.887125:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739013504 00000100:00100000:3.0:1788845886.887132:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739013504 00000100:00100000:3.0:1788845886.887192:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788845886.887201:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739013504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845886.887244:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739013504:12345-0@lo:400:kworker.0 Request processed in 44us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845886.887250:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788845886.887269:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739013632 00000100:00100000:3.0:1788845886.887272:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739013632 00000100:00100000:3.0:1788845886.887296:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788845886.887302:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739013632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845886.887328:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739013632:12345-0@lo:400:kworker.0 Request processed in 27us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845886.887333:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788845886.887346:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845886.887350:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788845886.887375:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d662680 x1875740739013632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845886.887387:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739013632:0@lo:400:kworker.0 00000100:00100000:3.0:1788845886.887408:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739013504:0@lo:400:kworker.0 00000100:00100000:1.0:1788845886.889199:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739013248:0@lo:400:kworker.0 00000100:00100000:1.0:1788845886.889261:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845886.889308:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739013760:0@lo:400:kworker.0 00000100:00100000:1.0:1788845886.889331:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845886.889357:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788845886.889362:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739013376:0@lo:400:kworker.0 00000100:00100000:1.0:1788845886.889383:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845886.889399:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739013888:0@lo:400:kworker.0 00000100:00100000:1.0:1788845886.889418:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845886.889444:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739013760 00000100:00100000:1.0:1788845886.889451:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739013760 00000100:00100000:1.0:1788845886.889485:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739013376 00000100:00100000:1.0:1788845886.889487:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739013376 00000100:00100000:1.0:1788845886.889517:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788845886.889524:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739013760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845886.889564:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739013760:12345-0@lo:400:kworker.0 Request processed in 41us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845886.889570:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788845886.889584:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788845886.889589:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739013376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845886.889624:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739013376:12345-0@lo:400:kworker.0 Request processed in 35us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845886.889629:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788845886.889661:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739013376:0@lo:400:kworker.0 00000100:00100000:1.0:1788845886.889670:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739013760:0@lo:400:kworker.0 00000100:00100000:3.0:1788845886.889751:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739013248 00000100:00100000:3.0:1788845886.889755:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739013248 00000100:00100000:3.0:1788845886.889802:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788845886.889810:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739013248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845886.889847:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739013248:12345-0@lo:400:kworker.0 Request processed in 38us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845886.889853:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788845886.889878:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739013888 00000100:00100000:3.0:1788845886.889882:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739013888 00000100:00100000:3.0:1788845886.889908:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788845886.889914:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739013888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845886.889942:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739013888:12345-0@lo:400:kworker.0 Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845886.889947:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788845886.889966:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845886.889970:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788845886.889989:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d660700 x1875740739013888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845886.889999:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739013888:0@lo:400:kworker.0 00000100:00100000:3.0:1788845886.890007:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739013248:0@lo:400:kworker.0 00000100:00100000:1.0:1788845886.893195:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845886.893214:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3537ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739014016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845886.893273:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845886.893315:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739014016 00000100:00100000:1.0:1788845886.893322:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739014016 00000100:00100000:1.0:1788845886.893366:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788845886.893375:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739014016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845886.893405:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845886.893444:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739014016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845886.893451:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788845886.893488:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3537ca80 x1875740739014016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845886.893516:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3537ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739014016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788845887.142453:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788845887.785727:0:8805:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788845888.167146:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845889.190394:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845889.958303:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3537ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739014144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845889.958378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845889.958458:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739014144 00000100:00100000:1.0:1788845889.958465:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739014144 00000100:00100000:1.0:1788845889.958543:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788845889.958550:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845889.958557:0:6691:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788845889.958560:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739014144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845889.958565:0:6691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788845889.958591:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845889.958651:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739014144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845889.958658:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788845889.958695:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3537ca80 x1875740739014144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845889.958712:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3537ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739014144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788845890.217946:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845891.238576:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845891.484529:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845891.484575:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720110464 00000100:00100000:1.0:1788845891.484586:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720110464 00000100:00100000:1.0:1788845891.484636:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 193 00000100:00100000:1.0:1788845891.484645:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:2353:x1875740720110464:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845891.484975:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:2353:x1875740720110464:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 323us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845891.484984:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 193 00000100:00100000:3.0:1788845891.493547:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845891.494410:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720110592 00000100:00100000:0.0:1788845891.494420:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720110592 00000100:00100000:0.0:1788845891.494489:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:0.0:1788845891.494501:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720110592:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788845891.494575:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720110592:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 76us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845891.494582:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00080000:0.0:1788845891.494627:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845891.506658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845891.506690:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845891.507393:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720110720 00000100:00100000:3.0:1788845891.507403:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720110720 00000100:00100000:3.0:1788845891.508249:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720110848 00000100:00100000:3.0:1788845891.508255:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720110848 00000100:00100000:2.0:1788845891.508383:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1788845891.508395:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2354:x1875740720110720:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845891.508481:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2354:x1875740720110720:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 78us (1819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845891.508489:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00080000:0.0:1788845891.509097:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845891.509251:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845891.509449:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:3.0:1788845891.509459:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2353:x1875740720110848:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845891.509514:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2353:x1875740720110848:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 56us (2823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845891.509521:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000001:02000400:1.0:1788845891.621908:0:9050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing yml_node 00000100:00100000:1.0:1788845892.007284:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788845892.007309:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739014272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845892.007374:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845892.007509:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739014272 00000100:00100000:0.0:1788845892.007525:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739014272 00000100:00100000:0.0:1788845892.007639:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788845892.007649:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739014272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845892.007682:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845892.007733:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739014272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845892.007740:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788845892.007780:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e1f80 x1875740739014272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845892.007799:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739014272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845892.012284:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739014400:0@lo:400:kworker.0 00000100:00100000:0.0:1788845892.012350:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845892.012395:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875740739014912:0@lo:400:kworker.0 00000100:00100000:0.0:1788845892.012422:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845892.012448:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845892.012453:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739014784:0@lo:400:kworker.0 00000100:00100000:0.0:1788845892.012488:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845892.012518:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739014528:0@lo:400:kworker.0 00000100:00100000:0.0:1788845892.012541:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845892.012557:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845892.012562:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739014656:0@lo:400:kworker.0 00000100:00100000:0.0:1788845892.012580:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845892.012607:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739014912 00000100:00100000:0.0:1788845892.012614:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739014912 00000100:00100000:2.0:1788845892.015118:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739014528 00000100:00100000:2.0:1788845892.015131:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739014528 00000100:00100000:2.0:1788845892.015190:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739014656 00000100:00100000:2.0:1788845892.015194:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739014656 00000100:00080000:1.0:1788845892.017297:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845892.017322:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739014400 00000100:00100000:1.0:1788845892.017332:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739014400 00000100:00100000:1.0:1788845892.017389:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788845892.017401:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3310:x1875740739014400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845892.017501:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3310:x1875740739014400:12345-0@lo:400:kworker.0 Request processed in 102us (5150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845892.017518:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:1.0:1788845892.017559:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845892.018029:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788845892.018041:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739014528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845892.018111:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739014528:12345-0@lo:400:kworker.0 Request processed in 73us (5568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845892.018119:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788845892.018135:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788845892.018143:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875740739014912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845892.018206:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875740739014912:12345-0@lo:400:kworker.0 Request processed in 64us (5782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845892.018212:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788845892.018277:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739014400:0@lo:400:kworker.0 00000100:00100000:0.0:1788845892.018294:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875740739014912:0@lo:400:kworker.0 00000100:00100000:1.0:1788845892.018330:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739014528:0@lo:400:kworker.0 00000100:00100000:3.0:1788845892.018443:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739014784 00000100:00100000:3.0:1788845892.018450:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739014784 00000100:00100000:3.0:1788845892.018533:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788845892.018543:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739014784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845892.018585:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739014784:12345-0@lo:400:kworker.0 Request processed in 44us (6096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845892.018591:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788845892.023212:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788845892.023227:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739014656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845892.023310:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739014656:12345-0@lo:400:kworker.0 Request processed in 87us (10727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845892.023324:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788845892.023377:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739014656:0@lo:400:kworker.0 00010000:00080000:0.0:1788845892.024907:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c1841d880 x1875740739014784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845892.024922:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739014784:0@lo:400:kworker.0 00000100:00080000:0.0:1788845892.024945:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788845892.262247:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845893.286418:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845894.310285:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845895.078968:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739015040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845895.079034:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845895.079228:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739015040 00000100:00100000:0.0:1788845895.079236:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739015040 00000100:00100000:0.0:1788845895.079298:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788845895.079308:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739015040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845895.079339:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845895.079386:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739015040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845895.079393:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788845895.079463:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788845895.079516:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e0a80 x1875740739015040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845895.079535:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739015040:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788845895.154944:0:9241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.105 00010000:00010000:0.0:1788845895.340493:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845896.359220:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845896.607622:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845896.607802:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845896.607838:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720111104 00000100:00100000:0.0:1788845896.607847:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720111104 00000100:00100000:0.0:1788845896.607904:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:3.0:1788845896.608020:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720110976 00000100:00100000:3.0:1788845896.608025:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720110976 00000100:00100000:3.0:1788845896.608052:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 195 00000100:00100000:3.0:1788845896.608058:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+10:2353:x1875740720110976:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845896.608123:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+10:2353:x1875740720110976:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 64us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845896.608130:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 195 00000100:00080000:3.0:1788845896.608289:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845896.608345:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720111104:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788845896.609320:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720111104:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 1404us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845896.609329:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:0.0:1788845896.612128:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845896.612207:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845896.612693:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720111232 00000100:00100000:2.0:1788845896.612703:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720111232 00000100:00100000:3.0:1788845896.612739:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720111360 00000100:00100000:3.0:1788845896.612746:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720111360 00000100:00100000:2.0:1788845896.612822:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:2.0:1788845896.612835:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+5:2350:x1875740720111232:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:2.0:1788845896.612872:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773eee3 00000100:00080000:2.0:1788845896.612882:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d138800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788845896.612914:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788845896.613276:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+2:2350:x1875740720111232:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 444us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845896.613283:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00010000:00010000:0.0:1788845896.614381:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788845896.616063:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845896.616319:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:2.0:1788845896.616334:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2350:x1875740720111360:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:2.0:1788845896.616391:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773eeea 00000100:00080000:2.0:1788845896.616414:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9a0c352ff800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788845896.616620:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1788845896.616712:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788845896.617089:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+2:2350:x1875740720111360:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 757us (4878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845896.617098:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00010000:00010000:0.0:1788845896.617644:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788845897.107402:0:9339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.105 00000100:00100000:0.0:1788845897.126507:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739015168:0@lo:400:kworker.0 00000100:00100000:0.0:1788845897.126578:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845897.126618:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739015680:0@lo:400:kworker.0 00000100:00100000:0.0:1788845897.126641:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845897.126664:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845897.126669:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739015552:0@lo:400:kworker.0 00000100:00100000:0.0:1788845897.126691:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845897.126717:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739015296:0@lo:400:kworker.0 00000100:00100000:0.0:1788845897.126738:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845897.126751:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739015808:0@lo:400:kworker.0 00000100:00100000:0.0:1788845897.126769:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845897.126784:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845897.126788:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739015424:0@lo:400:kworker.0 00000100:00100000:0.0:1788845897.126831:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845897.126868:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739015680 00000100:00100000:0.0:1788845897.126875:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739015680 00000100:00100000:0.0:1788845897.126917:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739015296 00000100:00100000:0.0:1788845897.126920:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739015296 00000100:00100000:0.0:1788845897.126930:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739015424 00000100:00100000:0.0:1788845897.126932:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739015424 00000100:00100000:0.0:1788845897.126946:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788845897.127096:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788845897.127111:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739015296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845897.127188:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739015296:12345-0@lo:400:kworker.0 Request processed in 77us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845897.127196:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788845897.127214:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788845897.127220:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739015424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845897.127246:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739015424:12345-0@lo:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845897.127252:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788845897.127315:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739015424:0@lo:400:kworker.0 00000100:00100000:3.0:1788845897.127326:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739015296:0@lo:400:kworker.0 00000100:00100000:1.0:1788845897.127470:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739015168 00000100:00100000:1.0:1788845897.127475:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739015168 00000100:00100000:1.0:1788845897.127505:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788845897.127512:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739015168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845897.127551:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739015168:12345-0@lo:400:kworker.0 Request processed in 40us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845897.127557:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788845897.127609:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739015168:0@lo:400:kworker.0 00000100:00100000:3.0:1788845897.127730:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739015936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845897.127761:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845897.127849:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739015936 00000100:00100000:1.0:1788845897.127854:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739015936 00000100:00100000:1.0:1788845897.127922:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788845897.127929:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739015936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845897.127965:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845897.128005:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739015936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845897.128011:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788845897.128080:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739015680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845897.128118:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739015680:12345-0@lo:400:kworker.0 Request processed in 1165us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845897.128125:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788845897.128146:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739015552 00000100:00100000:0.0:1788845897.128149:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739015552 00000100:00100000:0.0:1788845897.128196:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739015808 00000100:00100000:0.0:1788845897.128200:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739015808 00000100:00100000:0.0:1788845897.128218:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788845897.128224:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739015552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845897.128255:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739015552:12345-0@lo:400:kworker.0 Request processed in 31us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845897.128261:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788845897.128272:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788845897.128277:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739015808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845897.128308:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739015808:12345-0@lo:400:kworker.0 Request processed in 30us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845897.128313:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788845897.128331:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788845897.128334:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845897.128342:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788845897.128609:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c1841ea00 x1875740739015808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845897.128622:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739015808:0@lo:400:kworker.0 00010000:00080000:1.0:1788845897.128768:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e2d80 x1875740739015936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845897.128781:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739015936:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788845897.128804:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c1841d500 x1875740739015552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845897.128903:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739015552:0@lo:400:kworker.0 00000100:00100000:1.0:1788845897.128918:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739015680:0@lo:400:kworker.0 00010000:00010000:2.0:1788845897.382423:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845898.406387:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788845899.030209:0:9437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.105 00000001:00100000:3.0:1788845899.234535:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4592a189-21d8-449a-9335-07bfe0dc7877 00000020:00000080:3.0:1788845899.234543:0:6720:0:(genops.c:885:class_export_put()) final put ffff9a0c3d13e000/4592a189-21d8-449a-9335-07bfe0dc7877 00000020:00000080:1.0:1788845899.234775:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3d13e000/4592a189-21d8-449a-9335-07bfe0dc7877 for lustre-OST0000 00000020:00000080:1.0:1788845899.234822:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c3d138800 for lustre-OST0000 00010000:00010000:0.0:1788845899.430382:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845900.198438:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739016064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845900.198533:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845900.198700:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739016064 00000100:00100000:3.0:1788845900.198708:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739016064 00000100:00100000:3.0:1788845900.198772:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788845900.198781:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c2060ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739016064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788845900.198813:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845900.198873:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c2060ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739016064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845900.198881:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788845900.198940:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788845900.199081:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e2d80 x1875740739016064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845900.199100:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739016064:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788845900.318766:0:9486:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 01:38:19 EDT 2026 00010000:00010000:2.0:1788845900.461795:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788845900.737499:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4592a189-21d8-449a-9335-07bfe0dc7877 00000020:00000080:0.0:1788845900.737509:0:7645:0:(genops.c:885:class_export_put()) final put ffff9a0c352fb000/4592a189-21d8-449a-9335-07bfe0dc7877 00000020:00000080:1.0:1788845900.737579:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c352fb000/4592a189-21d8-449a-9335-07bfe0dc7877 for lustre-OST0001 00000020:00000080:1.0:1788845900.737631:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c352ff800 for lustre-OST0001 00010000:00010000:2.0:1788845901.482275:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845901.725862:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845901.725907:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845901.725938:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720111616 00000100:00100000:3.0:1788845901.725947:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720111616 00000100:00100000:3.0:1788845901.726007:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:3.0:1788845901.726016:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720111616:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845901.726049:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720111488 00000100:00100000:2.0:1788845901.726053:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720111488 00000100:00100000:2.0:1788845901.726081:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 197 00000100:00100000:3.0:1788845901.726082:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720111616:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 67us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845901.726088:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:2352:x1875740720111488:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845901.726089:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00080000:3.0:1788845901.726109:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845901.726112:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:2352:x1875740720111488:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 26us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845901.726118:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 197 00000100:00100000:0.0:1788845902.246323:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c20608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739016576:0@lo:400:kworker.0 00000100:00100000:0.0:1788845902.246393:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845902.246452:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788845902.246458:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c2060bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739016192:0@lo:400:kworker.0 00000100:00100000:0.0:1788845902.246488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845902.246511:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c20609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739016704:0@lo:400:kworker.0 00000100:00100000:0.0:1788845902.246536:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845902.246567:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739016576 00000100:00100000:0.0:1788845902.246574:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739016576 00000100:00100000:0.0:1788845902.246622:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788845902.246631:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c2060b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739016576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845902.246680:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c2060b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739016576:12345-0@lo:400:kworker.0 Request processed in 50us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845902.246687:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788845902.246708:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739016704 00000100:00100000:0.0:1788845902.246717:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739016704 00000100:00100000:0.0:1788845902.246742:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788845902.246748:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c2060a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739016704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845902.246775:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c2060a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739016704:12345-0@lo:400:kworker.0 Request processed in 27us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845902.246778:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c20609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740739016448:0@lo:400:kworker.0 00000100:00100000:0.0:1788845902.246789:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788845902.246805:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845902.246821:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788845902.246826:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c20609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739016320:0@lo:400:kworker.0 00000100:00100000:0.0:1788845902.246830:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c20609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739016704:0@lo:400:kworker.0 00010000:00080000:0.0:1788845902.246843:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c20608e00 x1875740739016576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845902.246845:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845902.246853:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c20608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739016576:0@lo:400:kworker.0 00000100:00100000:1.0:1788845902.246857:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c2060b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739016832:0@lo:400:kworker.0 00000100:00100000:1.0:1788845902.246873:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845902.246886:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739016832 00000100:00100000:0.0:1788845902.246889:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739016832 00000100:00100000:1.0:1788845902.246912:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739016192 00000100:00100000:0.0:1788845902.246913:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788845902.246915:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739016192 00000100:00100000:0.0:1788845902.246918:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739016832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845902.246940:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788845902.246946:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739016192:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788845902.247033:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845902.247037:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788845902.247040:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845902.247049:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739016448 00000100:00100000:3.0:1788845902.247052:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739016448 00000100:00100000:3.0:1788845902.247077:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739016320 00000100:00100000:3.0:1788845902.247079:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739016320 00000100:00100000:3.0:1788845902.247096:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788845902.247102:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740739016448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845902.247141:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740739016448:12345-0@lo:400:kworker.0 Request processed in 39us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845902.247148:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788845902.247181:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788845902.247188:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739016320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845902.247225:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739016320:12345-0@lo:400:kworker.0 Request processed in 37us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845902.247231:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788845902.247259:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c20609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739016320:0@lo:400:kworker.0 00000100:00100000:3.0:1788845902.247268:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c20609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740739016448:0@lo:400:kworker.0 00000100:00080000:3.0:1788845902.247288:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845902.247472:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739016832:12345-0@lo:400:kworker.0 Request processed in 552us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845902.247479:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788845902.247700:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739016192:12345-0@lo:400:kworker.0 Request processed in 753us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845902.247708:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788845902.247781:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c2060bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739016192:0@lo:400:kworker.0 00010000:00080000:3.0:1788845902.249259:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c2060b800 x1875740739016832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845902.249275:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c2060b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739016832:0@lo:400:kworker.0 00000100:00100000:3.0:1788845902.249304:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739016960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845902.249371:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845902.249847:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739016960 00000100:00100000:1.0:1788845902.249854:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739016960 00000100:00100000:1.0:1788845902.249892:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788845902.249908:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739016960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845902.249952:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845902.249998:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739016960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845902.250005:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788845902.250203:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e0e00 x1875740739016960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845902.250220:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739016960:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788845902.502277:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845903.526433:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845904.551859:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845905.319170:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845905.319199:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739017088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845905.319293:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845905.319382:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739017088 00000100:00100000:2.0:1788845905.319389:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739017088 00000100:00100000:2.0:1788845905.319464:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788845905.319473:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739017088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845905.319513:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845905.319557:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739017088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845905.319565:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788845905.319585:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788845905.319613:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c352ac000 x1875740739017088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845905.319632:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739017088:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788845905.575244:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845906.599767:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845906.850112:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845906.850234:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845906.850658:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720111872 00000100:00100000:2.0:1788845906.850668:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720111872 00000100:00100000:2.0:1788845906.850732:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:2.0:1788845906.850742:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c20608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720111872:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845906.850809:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c20608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720111872:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 69us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845906.850816:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00080000:3.0:1788845906.851441:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845906.853107:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720111744 00000100:00100000:1.0:1788845906.853118:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720111744 00000100:00100000:1.0:1788845906.853252:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 199 00000100:00100000:1.0:1788845906.853264:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:2353:x1875740720111744:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845906.853337:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:2353:x1875740720111744:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 76us (3233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845906.853344:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 199 00000100:00100000:1.0:1788845907.368123:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739017216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845907.368212:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845907.372011:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739017216 00000100:00100000:1.0:1788845907.372024:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739017216 00000100:00100000:1.0:1788845907.372088:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788845907.372097:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739017216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845907.372135:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845907.372230:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739017216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (4018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845907.372237:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788845907.372287:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e1880 x1875740739017216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845907.372305:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739017216:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788845907.372556:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788845907.372774:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739017472:0@lo:400:kworker.0 00000100:00100000:3.0:1788845907.372811:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845907.372835:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788845907.372841:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739017344:0@lo:400:kworker.0 00000100:00100000:3.0:1788845907.372865:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845907.372888:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875740739017856:0@lo:400:kworker.0 00000100:00100000:3.0:1788845907.372921:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845907.374457:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739017472 00000100:00100000:0.0:1788845907.374468:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739017472 00000100:00100000:0.0:1788845907.374516:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739017856 00000100:00100000:0.0:1788845907.374518:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739017856 00000100:00100000:0.0:1788845907.374545:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788845907.374553:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739017472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845907.374635:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739017344 00000100:00100000:1.0:1788845907.374640:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739017344 00000100:00100000:1.0:1788845907.374665:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788845907.374671:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3310:x1875740739017344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845907.374770:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788845907.374779:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875740739017856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845907.374850:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739017472:12345-0@lo:400:kworker.0 Request processed in 297us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845907.374872:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788845907.374895:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845907.375189:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3310:x1875740739017344:12345-0@lo:400:kworker.0 Request processed in 516us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845907.375195:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788845907.375235:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739017600:0@lo:400:kworker.0 00000100:00100000:1.0:1788845907.375265:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845907.375292:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845907.375297:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739017728:0@lo:400:kworker.0 00000100:00100000:1.0:1788845907.375335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845907.375366:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739017728 00000100:00100000:1.0:1788845907.375369:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739017728 00000100:00100000:1.0:1788845907.375413:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788845907.375420:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739017728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845907.375454:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739017728:12345-0@lo:400:kworker.0 Request processed in 35us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845907.375460:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788845907.375551:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788845907.375576:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c1841c700 x1875740739017728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845907.375590:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739017728:0@lo:400:kworker.0 00000100:00100000:0.0:1788845907.375811:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739017600 00000100:00100000:0.0:1788845907.375815:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739017600 00000100:00100000:0.0:1788845907.375852:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788845907.375858:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739017600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845907.375891:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739017600:12345-0@lo:400:kworker.0 Request processed in 34us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845907.375897:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788845907.376047:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845907.376067:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739017600:0@lo:400:kworker.0 00000100:00100000:3.0:1788845907.376344:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739017472:0@lo:400:kworker.0 00000100:00100000:3.0:1788845907.376368:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739017344:0@lo:400:kworker.0 00000100:00100000:2.0:1788845907.376539:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875740739017856:12345-0@lo:400:kworker.0 Request processed in 1760us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845907.376547:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788845907.384718:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875740739017856:0@lo:400:kworker.0 00010000:00010000:0.0:1788845907.624144:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845908.646859:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845909.671639:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845910.438398:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845910.438423:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739017984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845910.438486:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845910.438755:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739017984 00000100:00100000:2.0:1788845910.438763:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739017984 00000100:00100000:2.0:1788845910.438844:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788845910.438854:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c20609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739017984:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788845910.438998:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788845910.439471:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845910.439533:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c20609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739017984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 680us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845910.439541:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788845910.439633:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c352ac000 x1875740739017984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845910.439654:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739017984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788845910.694329:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845911.719944:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845911.964652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845911.964697:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845911.964726:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720112000 00000100:00100000:3.0:1788845911.964734:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720112000 00000100:00100000:3.0:1788845911.964781:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 201 00000100:00100000:3.0:1788845911.964790:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:2354:x1875740720112000:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845911.964850:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+10:2354:x1875740720112000:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 61us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845911.964858:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 201 00000100:00100000:1.0:1788845911.966354:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720112128 00000100:00100000:1.0:1788845911.966376:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720112128 00000100:00100000:1.0:1788845911.966450:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:1.0:1788845911.966460:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2354:x1875740720112128:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845911.966526:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2354:x1875740720112128:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 67us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845911.966533:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00080000:3.0:1788845911.967500:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788845912.395369:0:10117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:38:30 (1788845910) === 00000100:00100000:3.0:1788845912.487339:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845912.487370:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739018112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845912.487433:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845912.487608:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739018112 00000100:00100000:1.0:1788845912.487615:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739018112 00000100:00100000:1.0:1788845912.487667:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788845912.487800:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739018112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845912.487832:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845912.487873:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739018112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 197us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845912.487879:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788845912.487905:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739018368:0@lo:400:kworker.0 00000100:00100000:1.0:1788845912.487933:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845912.487952:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845912.487958:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739018496:0@lo:400:kworker.0 00000100:00100000:1.0:1788845912.487979:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788845912.488004:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788845912.488049:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739018240:0@lo:400:kworker.0 00000100:00100000:3.0:1788845912.488081:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845912.488111:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739018752:0@lo:400:kworker.0 00000100:00100000:3.0:1788845912.488133:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788845912.488187:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e2300 x1875740739018112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845912.488206:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739018112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845912.488228:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845912.488243:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739018624:0@lo:400:kworker.0 00000100:00100000:3.0:1788845912.488269:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845912.488295:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739018368 00000100:00100000:3.0:1788845912.488299:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739018368 00000100:00100000:3.0:1788845912.488324:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739018496 00000100:00100000:3.0:1788845912.488326:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739018496 00000100:00100000:3.0:1788845912.488340:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739018752 00000100:00100000:3.0:1788845912.488342:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739018752 00000100:00100000:3.0:1788845912.488355:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788845912.488380:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739018368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845912.488417:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739018368:12345-0@lo:400:kworker.0 Request processed in 56us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845912.488423:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788845912.488442:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788845912.488449:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739018496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845912.488476:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739018496:12345-0@lo:400:kworker.0 Request processed in 28us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845912.488482:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788845912.488494:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788845912.488500:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739018752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845912.488529:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739018752:12345-0@lo:400:kworker.0 Request processed in 30us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845912.488535:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788845912.488552:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739018624 00000100:00100000:3.0:1788845912.488556:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739018624 00000100:00100000:3.0:1788845912.488591:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788845912.488597:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739018624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845912.488636:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739018624:12345-0@lo:400:kworker.0 Request processed in 39us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845912.488642:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788845912.488669:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e2680 x1875740739018624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845912.488802:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739018624:0@lo:400:kworker.0 00000100:00100000:3.0:1788845912.488817:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739018752:0@lo:400:kworker.0 00000100:00100000:1.0:1788845912.488961:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739018240 00000100:00100000:1.0:1788845912.488965:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739018240 00000100:00100000:1.0:1788845912.489001:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788845912.489008:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739018240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845912.489053:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739018240:12345-0@lo:400:kworker.0 Request processed in 47us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845912.489060:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:1.0:1788845912.489088:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845912.489092:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845912.489110:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739018496:0@lo:400:kworker.0 00000100:00100000:1.0:1788845912.489119:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739018368:0@lo:400:kworker.0 00000100:00100000:1.0:1788845912.489143:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739018240:0@lo:400:kworker.0 00000100:00100000:3.0:1788845912.728806:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845912.728906:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720112256 00000100:00100000:1.0:1788845912.728915:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720112256 00000100:00100000:1.0:1788845912.728971:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 203 00000100:00100000:1.0:1788845912.728981:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+10:8123:x1875740720112256:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788845912.728996:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845912.729012:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475600/0x1345bc80c773efae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cc40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845912.729039:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475600/0x1345bc80c773efae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc40 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845912.729286:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475600/0x1345bc80c773efae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc40 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845912.729299:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475600, rc 0) 00000100:00100000:1.0:1788845912.729353:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+11:8123:x1875740720112256:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 373us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845912.729370:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 203 00000100:00100000:0.0:1788845912.735660:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845912.735955:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720112384 00000100:00100000:3.0:1788845912.735965:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720112384 00000100:00100000:3.0:1788845912.736019:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 204 00000100:00100000:3.0:1788845912.736029:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+11:8123:x1875740720112384:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788845912.736354:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+11:8123:x1875740720112384:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 325us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845912.736371:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 204 00000100:00100000:3.0:1788845912.741713:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:2.0:1788845912.742428:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845912.744750:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720112512 00000100:00100000:1.0:1788845912.744763:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720112512 00000100:00100000:1.0:1788845912.744825:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 205 00000100:00100000:1.0:1788845912.744836:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+11:8123:x1875740720112512:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788845912.745050:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+11:8123:x1875740720112512:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 215us (3345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845912.745068:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 205 00000100:00100000:0.0:1788845912.754314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845912.754579:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720112640 00000100:00100000:2.0:1788845912.754589:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720112640 00000100:00100000:2.0:1788845912.754638:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 206 00000100:00100000:2.0:1788845912.754647:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+11:8127:x1875740720112640:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788845912.755606:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+11:8127:x1875740720112640:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 255us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845912.755620:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 206 00000100:00100000:0.0:1788845912.781143:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845912.781255:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720112768 00000100:00100000:1.0:1788845912.781266:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720112768 00000100:00100000:1.0:1788845912.781322:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 207 00000100:00100000:1.0:1788845912.781332:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+11:8127:x1875740720112768:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788845912.781614:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+11:8127:x1875740720112768:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 282us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845912.781622:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 207 00000100:00100000:3.0:1788845912.791941:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845912.792089:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720112896 00000100:00100000:1.0:1788845912.792098:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720112896 00000100:00100000:1.0:1788845912.792186:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 208 00000100:00100000:1.0:1788845912.792197:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+11:8123:x1875740720112896:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788845912.792212:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845912.792228:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475000/0x1345bc80c773efb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cc6a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845912.792257:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475000/0x1345bc80c773efb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc6a expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845912.792279:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475000/0x1345bc80c773efb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc6a expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845912.792303:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475000, rc 0) 00000100:00100000:1.0:1788845912.792369:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+12:8123:x1875740720112896:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 165us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845912.792376:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 208 00000100:00100000:0.0:1788845912.799268:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845912.799337:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720113024 00000100:00100000:2.0:1788845912.799349:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720113024 00000100:00100000:2.0:1788845912.799413:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 209 00000100:00100000:2.0:1788845912.799423:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+12:8123:x1875740720113024:12345-192.168.206.48@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788845912.799448:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788845912.799471:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788845912.799475:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788845912.799478:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788845912.799480:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788845912.805579:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+12:8123:x1875740720113024:12345-192.168.206.48@tcp:256:mount.lustre.0 Request processed in 6147us (6309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845912.805593:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 209 00000100:00100000:0.0:1788845912.810641:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845912.810842:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720113152 00000100:00100000:1.0:1788845912.810853:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720113152 00000100:00100000:1.0:1788845912.811002:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 210 00000100:00100000:1.0:1788845912.811013:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+12:8123:x1875740720113152:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788845912.811041:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845912.811060:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475800/0x1345bc80c773efbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cc71 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845912.811089:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475800/0x1345bc80c773efbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc71 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845912.811101:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475800/0x1345bc80c773efbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc71 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845912.811478:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475800, rc 0) 00000100:00100000:1.0:1788845912.811649:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:8123:x1875740720113152:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 638us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845912.811657:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 210 00000100:00100000:0.0:1788845912.814079:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845912.816020:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720113280 00000100:00100000:2.0:1788845912.816033:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720113280 00000100:00100000:2.0:1788845912.816267:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 211 00000100:00100000:2.0:1788845912.816279:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:8123:x1875740720113280:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788845912.816593:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:8123:x1875740720113280:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 316us (2520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845912.816601:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 211 00000100:00100000:0.0:1788845912.821673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845912.823424:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720113408 00000100:00100000:2.0:1788845912.823436:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720113408 00000100:00100000:2.0:1788845912.823500:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 212 00000100:00100000:2.0:1788845912.823717:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:8123:x1875740720113408:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788845912.823964:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:8123:x1875740720113408:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 251us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845912.828661:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 212 00000100:00100000:0.0:1788845912.837567:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845912.837690:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720113536 00000100:00100000:3.0:1788845912.837700:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720113536 00000100:00100000:3.0:1788845912.837793:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 213 00000100:00100000:3.0:1788845912.837804:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:8132:x1875740720113536:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788845912.838055:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:8132:x1875740720113536:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 252us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845912.838064:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 213 00000100:00100000:0.0:1788845912.842891:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845912.843026:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720113664 00000100:00100000:2.0:1788845912.843035:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720113664 00000100:00100000:2.0:1788845912.843102:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 214 00000100:00100000:2.0:1788845912.843112:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:8132:x1875740720113664:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788845912.843390:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:8132:x1875740720113664:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 277us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845912.843398:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 214 00000100:00100000:0.0:1788845912.847931:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845912.847963:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845912.848145:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720113792 00000100:00100000:1.0:1788845912.848186:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720113792 00000100:00100000:1.0:1788845912.848227:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720114176 00000100:00100000:1.0:1788845912.848231:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720114176 00000100:00100000:1.0:1788845912.848281:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:1.0:1788845912.848291:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c20608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720114176:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845912.848376:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c20608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720114176:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 86us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845912.848384:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:1.0:1788845912.848401:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1788845912.848406:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c2060b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1875740720113792:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788845912.848432:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d8450d7e-d658-40b4-8296-b4731edf9929@192.168.206.48@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1788845912.848467:0:5847:0:(genops.c:1385:class_connect()) connect: client d8450d7e-d658-40b4-8296-b4731edf9929, cookie 0x1345bc80c773efc3 00000004:00100000:1.0:1788845912.848495:0:5847:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788845912.848735:0:5847:0:(import.c:65:import_set_state_nolock()) ffff9a0c34df7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845912.848765:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c2060b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8450d7e-d658-40b4-8296-b4731edf9929+6:2350:x1875740720113792:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 357us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845912.848772:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:0.0:1788845912.869577:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845912.869617:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845912.869721:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720114048 00000100:00100000:2.0:1788845912.869731:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720114048 00000100:00100000:2.0:1788845912.869804:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720113920 00000100:00100000:2.0:1788845912.869807:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720113920 00000100:00100000:2.0:1788845912.869834:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:2.0:1788845912.869843:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c20608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+7:8123:x1875740720114048:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788845912.869913:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788845912.869992:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c20608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+7:8123:x1875740720114048:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 150us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845912.870000:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:2.0:1788845912.870019:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:2.0:1788845912.870026:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c2060a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+6:0:x1875740720113920:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788845912.870038:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788845912.870078:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c2060a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+6:0:x1875740720113920:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 52us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845912.870084:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00080000:3.0:1788845912.870593:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845912.872331:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845912.872426:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720114304 00000100:00100000:2.0:1788845912.872435:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720114304 00000100:00100000:2.0:1788845912.872487:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:2.0:1788845912.872497:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+6:8123:x1875740720114304:12345-192.168.206.48@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788845912.872569:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+6:8123:x1875740720114304:12345-192.168.206.48@tcp:40:mount.lustre.0 Request processed in 73us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845912.872576:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:2.0:1788845912.875293:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845912.875403:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720114432 00000100:00100000:1.0:1788845912.875413:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720114432 00000100:00100000:1.0:1788845912.875458:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1788845912.875466:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875740720114432:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788845912.875499:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d8450d7e-d658-40b4-8296-b4731edf9929@192.168.206.48@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1788845912.875531:0:6690:0:(genops.c:1385:class_connect()) connect: client d8450d7e-d658-40b4-8296-b4731edf9929, cookie 0x1345bc80c773efca 00002000:00100000:1.0:1788845912.875542:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d8450d7e-d658-40b4-8296-b4731edf9929/ffff9a0c34df2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788845912.875565:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788845912.875798:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788845912.875862:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9a0b06a01000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845912.876346:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8450d7e-d658-40b4-8296-b4731edf9929+6:2350:x1875740720114432:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 878us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845912.876354:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1788845912.878677:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845912.878736:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845912.879148:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720114688 00000100:00100000:2.0:1788845912.879188:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720114688 00000100:00100000:2.0:1788845912.879242:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:2.0:1788845912.879252:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8450d7e-d658-40b4-8296-b4731edf9929+6:8123:x1875740720114688:12345-192.168.206.48@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788845912.879319:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788845912.879401:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8450d7e-d658-40b4-8296-b4731edf9929+6:8123:x1875740720114688:12345-192.168.206.48@tcp:33:mount.lustre.0 Request processed in 149us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845912.879421:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:3.0:1788845912.879518:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720114560 00000100:00100000:3.0:1788845912.879523:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720114560 00000100:00100000:3.0:1788845912.879558:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1788845912.879563:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875740720114560:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788845912.879586:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d8450d7e-d658-40b4-8296-b4731edf9929@192.168.206.48@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1788845912.879612:0:6689:0:(genops.c:1385:class_connect()) connect: client d8450d7e-d658-40b4-8296-b4731edf9929, cookie 0x1345bc80c773efd1 00002000:00100000:3.0:1788845912.879622:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d8450d7e-d658-40b4-8296-b4731edf9929/ffff9a0c0744e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788845912.879632:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788845912.879840:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788845912.879867:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9a0c0744f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845912.879898:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8450d7e-d658-40b4-8296-b4731edf9929+6:2350:x1875740720114560:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 333us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845912.879917:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00010000:00010000:0.0:1788845913.766694:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788845914.586737:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d8450d7e-d658-40b4-8296-b4731edf9929 00010000:00010000:1.0:1788845914.797827:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845915.558537:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788845915.558592:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c20608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739018880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845915.558650:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845915.558708:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739018880 00000100:00100000:1.0:1788845915.558717:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739018880 00000100:00080000:3.0:1788845915.558757:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845915.558779:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788845915.558787:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739018880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845915.558818:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845915.558866:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739018880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845915.558873:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788845915.559243:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c20608380 x1875740739018880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845915.559263:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c20608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739018880:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788845915.814432:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788845916.100695:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d8450d7e-d658-40b4-8296-b4731edf9929 00000001:00100000:0.0:1788845916.117507:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d8450d7e-d658-40b4-8296-b4731edf9929 00010000:00010000:0.0:1788845916.838308:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788845917.351758:0:10315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1788845917.607399:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845917.607421:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739019008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845917.607494:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845917.607560:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739019008 00000100:00100000:1.0:1788845917.607567:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739019008 00000100:00100000:1.0:1788845917.607627:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788845917.607637:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739019008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845917.607670:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845917.607713:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739019008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845917.607720:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788845917.607776:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e0a80 x1875740739019008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845917.607796:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739019008:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788845917.607907:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788845917.609813:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740739019264:0@lo:400:kworker.0 00000100:00100000:2.0:1788845917.609824:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739019520:0@lo:400:kworker.0 00000100:00100000:0.0:1788845917.609907:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739019392:0@lo:400:kworker.0 00000100:00100000:2.0:1788845917.610008:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845917.610048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845917.610090:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788845917.610097:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739019136:0@lo:400:kworker.0 00000100:00100000:3.0:1788845917.610127:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845917.610150:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739019648:0@lo:400:kworker.0 00000100:00100000:3.0:1788845917.610189:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845917.610217:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739019264 00000100:00100000:3.0:1788845917.610224:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739019264 00000100:00100000:3.0:1788845917.610262:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739019648 00000100:00100000:3.0:1788845917.610265:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739019648 00000100:00100000:3.0:1788845917.610290:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788845917.610298:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740739019264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845917.610352:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740739019264:12345-0@lo:400:kworker.0 Request processed in 54us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845917.610358:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788845917.610373:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788845917.610379:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739019648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845917.610404:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739019648:12345-0@lo:400:kworker.0 Request processed in 26us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845917.610410:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788845917.610427:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739019136 00000100:00100000:3.0:1788845917.610430:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739019136 00000100:00100000:2.0:1788845917.610457:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739019520 00000100:00100000:3.0:1788845917.610462:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788845917.610463:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739019520 00000100:00100000:3.0:1788845917.610473:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739019136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845917.610507:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788845917.610510:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739019136:12345-0@lo:400:kworker.0 Request processed in 40us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845917.610520:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788845917.610521:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739019520:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788845917.610560:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845917.610572:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845917.610599:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739019136:0@lo:400:kworker.0 00000100:00100000:3.0:1788845917.610620:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739019648:0@lo:400:kworker.0 00000100:00100000:3.0:1788845917.610629:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740739019264:0@lo:400:kworker.0 00000100:00100000:2.0:1788845917.610649:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739019520:12345-0@lo:400:kworker.0 Request processed in 131us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845917.610657:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788845917.610696:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c352adc00 x1875740739019520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845917.610707:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739019520:0@lo:400:kworker.0 00000100:00100000:0.0:1788845917.616932:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845917.617082:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739019392 00000100:00100000:3.0:1788845917.617093:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739019392 00000100:00100000:3.0:1788845917.617189:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788845917.617205:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c20609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739019392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845917.617269:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c20609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739019392:12345-0@lo:400:kworker.0 Request processed in 71us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845917.617277:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788845917.617324:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739019392:0@lo:400:kworker.0 00000100:00080000:0.0:1788845917.617353:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788845917.865751:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845918.111776:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845918.111814:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845918.111860:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845918.111972:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720115200 00000100:00100000:1.0:1788845918.111981:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720115200 00000100:00100000:1.0:1788845918.112038:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:1.0:1788845918.112048:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c2060aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720115200:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845918.112125:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c2060aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720115200:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 78us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845918.112132:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:1.0:1788845918.112184:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720114816 00000100:00100000:1.0:1788845918.112188:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720114816 00000100:00100000:1.0:1788845918.112212:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 216 00000100:00100000:1.0:1788845918.112219:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720114816:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845918.112243:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720114816:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 26us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845918.112249:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 216 00000100:00080000:1.0:1788845918.112272:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845918.112430:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720114944 00000100:00100000:3.0:1788845918.112435:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720114944 00000100:00100000:3.0:1788845918.112478:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:3.0:1788845918.112484:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c20609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720114944:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845918.112514:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c20609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720114944:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 30us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845918.112520:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:0.0:1788845918.112619:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845918.112794:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720115072 00000100:00100000:3.0:1788845918.112799:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720115072 00000100:00100000:3.0:1788845918.112840:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:3.0:1788845918.112847:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c20608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720115072:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845918.112883:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c20608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720115072:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845918.112889:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:3.0:1788845918.112979:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845918.113074:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720115328 00000100:00100000:3.0:1788845918.113078:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720115328 00000100:00100000:3.0:1788845918.113109:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:3.0:1788845918.113115:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720115328:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845918.113144:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720115328:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 30us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845918.113150:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00080000:1.0:1788845918.114856:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845918.114981:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788845918.887288:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845919.911904:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845920.679703:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845920.679734:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739019776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845920.679801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845920.679871:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739019776 00000100:00100000:1.0:1788845920.679878:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739019776 00000100:00100000:1.0:1788845920.679942:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788845920.679951:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739019776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845920.679983:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845920.680025:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739019776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845920.680032:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788845920.680051:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788845920.680081:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e0a80 x1875740739019776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845920.680100:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739019776:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788845920.936109:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845921.961516:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845922.726411:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c34be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739020032:0@lo:400:kworker.0 00000100:00100000:3.0:1788845922.726477:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845922.726533:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c34be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739020544:0@lo:400:kworker.0 00000100:00100000:1.0:1788845922.726557:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c34be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739019904:0@lo:400:kworker.0 00000100:00100000:3.0:1788845922.726559:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845922.726606:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845922.726609:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c34be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739020160:0@lo:400:kworker.0 00000100:00100000:1.0:1788845922.726642:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c34be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739020416:0@lo:400:kworker.0 00000100:00100000:3.0:1788845922.726648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845922.726675:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845922.726682:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845922.726685:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c34be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739020288:0@lo:400:kworker.0 00000100:00100000:3.0:1788845922.726726:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845922.726772:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739020544 00000100:00100000:1.0:1788845922.726780:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739020544 00000100:00100000:3.0:1788845922.726785:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739020032 00000100:00100000:3.0:1788845922.726790:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739020032 00000100:00100000:1.0:1788845922.726837:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739020288 00000100:00100000:3.0:1788845922.726839:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739020160 00000100:00100000:1.0:1788845922.726842:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739020288 00000100:00100000:3.0:1788845922.726844:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739020160 00000100:00100000:1.0:1788845922.726870:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788845922.726881:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739020544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845922.726883:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739020416 00000100:00100000:3.0:1788845922.726888:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739020416 00000100:00100000:3.0:1788845922.726908:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788845922.726916:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739020032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845922.726941:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739020544:12345-0@lo:400:kworker.0 Request processed in 62us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845922.727975:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739020032:12345-0@lo:400:kworker.0 Request processed in 43us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845922.727994:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788845922.728018:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788845922.728027:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739020160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845922.728179:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739020160:12345-0@lo:400:kworker.0 Request processed in 152us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845922.728186:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788845922.728200:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788845922.728207:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739020416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845922.728244:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739020416:12345-0@lo:400:kworker.0 Request processed in 38us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845922.728250:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788845922.728481:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c34be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739020160:0@lo:400:kworker.0 00000100:00080000:0.0:1788845922.730776:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845922.730786:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788845922.730789:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845922.732727:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788845922.732744:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788845922.732765:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739020288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845922.732825:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739020672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845922.732893:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845922.732906:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739020288:12345-0@lo:400:kworker.0 Request processed in 149us (6177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845922.732923:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788845922.732939:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c34be3800 x1875740739020288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845922.732968:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c34be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739020288:0@lo:400:kworker.0 00000100:00100000:3.0:1788845922.732975:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c34be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739020416:0@lo:400:kworker.0 00000100:00100000:1.0:1788845922.733007:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739020672 00000100:00100000:3.0:1788845922.733012:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c34be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739020032:0@lo:400:kworker.0 00000100:00100000:1.0:1788845922.733013:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739020672 00010000:00080000:3.0:1788845922.733029:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c34be2300 x1875740739020544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845922.733039:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c34be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739020544:0@lo:400:kworker.0 00000100:00100000:1.0:1788845922.733055:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788845922.733064:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739020672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845922.733089:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845922.733124:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739020672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845922.733130:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788845922.733179:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e2680 x1875740739020672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845922.733194:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739020672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845922.737278:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739019904 00000100:00100000:2.0:1788845922.737290:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739019904 00000100:00100000:2.0:1788845922.737345:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788845922.737355:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739019904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845922.737433:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739019904:12345-0@lo:400:kworker.0 Request processed in 80us (10827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845922.737440:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788845922.738637:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c34be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739019904:0@lo:400:kworker.0 00010000:00010000:0.0:1788845922.984740:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845923.232794:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845923.232835:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845923.232888:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845923.232919:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845923.232943:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845923.232952:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720115712 00000100:00100000:3.0:1788845923.232961:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720115584 00000100:00100000:0.0:1788845923.232961:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720115712 00000100:00100000:3.0:1788845923.232963:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720115584 00000100:00100000:1.0:1788845923.233009:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720115456 00000100:00100000:3.0:1788845923.233012:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:1.0:1788845923.233012:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720115456 00000100:00100000:1.0:1788845923.233037:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 218 00000100:00100000:1.0:1788845923.233045:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720115456:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845923.233061:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720115968 00000100:00100000:2.0:1788845923.233064:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720115968 00000100:00100000:2.0:1788845923.233089:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720115840 00000100:00100000:2.0:1788845923.233092:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720115840 00000100:00100000:1.0:1788845923.233105:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720115456:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 61us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845923.233109:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:1.0:1788845923.233113:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 218 00000100:00100000:2.0:1788845923.233115:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720115968:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845923.233142:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720115968:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 27us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845923.233142:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:2.0:1788845923.233149:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:1.0:1788845923.233149:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720115840:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845923.233204:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720115840:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 55us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845923.233210:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00080000:1.0:1788845923.233231:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845923.233234:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845923.233237:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845923.235408:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:0.0:1788845923.235424:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720115712:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788845923.235499:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720115712:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 79us (2663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845923.235523:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:3.0:1788845923.235559:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720115584:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845923.235598:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720115584:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 2578us (2678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845923.235607:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00010000:00010000:1.0:1788845924.006341:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845925.031669:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845925.798317:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845925.798337:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739020800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845925.798400:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845925.798507:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739020800 00000100:00100000:1.0:1788845925.798516:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739020800 00000100:00100000:1.0:1788845925.798593:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788845925.798603:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c20608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739020800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845925.798634:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788845925.798668:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845925.798686:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c20608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739020800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845925.798694:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788845925.798731:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e2680 x1875740739020800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845925.798750:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739020800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788845926.054329:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845927.078449:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845927.846395:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739020928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845927.846460:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845927.846692:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739020928 00000100:00100000:1.0:1788845927.846700:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739020928 00000100:00100000:1.0:1788845927.846753:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788845927.846762:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739020928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845927.846803:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845927.847106:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739020928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 344us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845927.847125:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788845927.847146:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845927.847677:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739021184:0@lo:400:kworker.0 00000100:00100000:1.0:1788845927.847713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845927.847737:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845927.847743:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739021312:0@lo:400:kworker.0 00000100:00100000:3.0:1788845927.847851:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739021056:0@lo:400:kworker.0 00000100:00100000:3.0:1788845927.847894:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845927.847919:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875740739021568:0@lo:400:kworker.0 00000100:00100000:3.0:1788845927.847947:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739021056 00000100:00100000:3.0:1788845927.847952:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739021056 00000100:00100000:3.0:1788845927.847984:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788845927.847992:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3310:x1875740739021056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845927.848031:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3310:x1875740739021056:12345-0@lo:400:kworker.0 Request processed in 40us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845927.848048:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788845927.848335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845927.848378:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739021184 00000100:00100000:1.0:1788845927.848382:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739021184 00000100:00100000:1.0:1788845927.848410:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739021312 00000100:00100000:1.0:1788845927.848413:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739021312 00000100:00100000:1.0:1788845927.848434:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788845927.848440:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739021184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845927.848475:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739021184:12345-0@lo:400:kworker.0 Request processed in 36us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845927.848481:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788845927.848492:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788845927.848497:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739021312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845927.848520:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739021312:12345-0@lo:400:kworker.0 Request processed in 23us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845927.848525:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788845927.848541:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845927.848565:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739021312:0@lo:400:kworker.0 00000100:00100000:1.0:1788845927.848575:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739021184:0@lo:400:kworker.0 00000100:00100000:3.0:1788845927.848649:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845927.848682:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739021056:0@lo:400:kworker.0 00000100:00100000:3.0:1788845927.848692:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788845927.848697:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739021440:0@lo:400:kworker.0 00000100:00100000:3.0:1788845927.848719:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845927.848754:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739021440 00000100:00100000:3.0:1788845927.848757:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739021440 00000100:00100000:3.0:1788845927.848798:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788845927.848805:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739021440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845927.848838:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739021440:12345-0@lo:400:kworker.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845927.848844:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788845927.848977:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788845927.848997:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c1841ea00 x1875740739021440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845927.849008:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739021440:0@lo:400:kworker.0 00000100:00100000:1.0:1788845927.849068:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739021568 00000100:00100000:1.0:1788845927.849078:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739021568 00000100:00100000:1.0:1788845927.849115:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788845927.849121:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875740739021568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845927.849177:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875740739021568:12345-0@lo:400:kworker.0 Request processed in 55us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845927.849183:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788845927.849250:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845927.849269:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875740739021568:0@lo:400:kworker.0 00010000:00080000:2.0:1788845927.857983:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e2680 x1875740739020928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845927.858011:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739020928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788845928.102260:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845928.351994:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845928.352036:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845928.352073:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845928.352091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845928.352122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845928.352148:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720116352 00000100:00100000:3.0:1788845928.352197:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720116352 00000100:00100000:3.0:1788845928.352259:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720116224 00000100:00100000:3.0:1788845928.352262:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720116224 00000100:00100000:3.0:1788845928.352300:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:3.0:1788845928.352310:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8450d7e-d658-40b4-8296-b4731edf9929+5:2351:x1875740720116352:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845928.352375:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8450d7e-d658-40b4-8296-b4731edf9929+5:2351:x1875740720116352:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 67us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845928.352383:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:3.0:1788845928.352412:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:3.0:1788845928.352419:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2351:x1875740720116224:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845928.352452:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2351:x1875740720116224:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 34us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845928.352458:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:3.0:1788845928.352476:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720116608 00000100:00100000:3.0:1788845928.352479:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720116608 00000100:00100000:3.0:1788845928.352502:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720116480 00000100:00100000:3.0:1788845928.352505:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720116480 00000100:00100000:3.0:1788845928.352522:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:3.0:1788845928.352528:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2351:x1875740720116608:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845928.352555:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2351:x1875740720116608:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 27us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845928.352561:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:3.0:1788845928.352573:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:3.0:1788845928.352578:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2351:x1875740720116480:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845928.352600:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2351:x1875740720116480:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845928.352606:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00080000:3.0:1788845928.352627:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845928.352631:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845928.352633:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845928.352875:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720116096 00000100:00100000:0.0:1788845928.352880:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720116096 00000100:00100000:0.0:1788845928.352910:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 220 00000100:00100000:0.0:1788845928.352917:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:2351:x1875740720116096:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788845928.352951:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:2351:x1875740720116096:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 35us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845928.352958:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 220 00010000:00010000:0.0:1788845929.128329:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845930.150348:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845930.918511:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739021696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845930.918584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845930.918921:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739021696 00000100:00100000:1.0:1788845930.918930:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739021696 00000100:00100000:1.0:1788845930.918994:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788845930.919013:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739021696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845930.919044:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845930.919089:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739021696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845930.919096:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788845930.919503:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c26321180 x1875740739021696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845930.919526:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739021696:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788845930.919870:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788845931.188010:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788845931.677205:0:11015:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788845932.198296:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845932.966235:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845932.966271:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739021824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845932.966402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845932.966464:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739021824 00000100:00100000:2.0:1788845932.966471:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739021824 00000100:00100000:2.0:1788845932.966530:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788845932.966541:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739021824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845932.966575:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845932.966620:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739021824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845932.966629:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788845932.966652:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788845932.966685:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c352ae680 x1875740739021824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845932.966701:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739021824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845932.969044:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845932.969197:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739022080:0@lo:400:kworker.0 00000100:00100000:0.0:1788845932.969270:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845932.969346:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739022336:0@lo:400:kworker.0 00000100:00100000:3.0:1788845932.969376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845932.969407:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739022080 00000100:00100000:3.0:1788845932.969409:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845932.969414:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875740739022208:0@lo:400:kworker.0 00000100:00100000:2.0:1788845932.969415:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739022080 00000100:00100000:3.0:1788845932.969444:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845932.969451:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739022208 00000100:00100000:2.0:1788845932.969453:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739022208 00000100:00100000:3.0:1788845932.969466:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739022336 00000100:00100000:3.0:1788845932.969469:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739022336 00000100:00100000:2.0:1788845932.969479:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788845932.969487:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c2060b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739022080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845932.969493:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788845932.969500:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739022336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845932.969528:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c2060b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739022080:12345-0@lo:400:kworker.0 Request processed in 42us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845932.969529:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739022336:12345-0@lo:400:kworker.0 Request processed in 31us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845932.969536:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788845932.969536:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788845932.969551:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788845932.969557:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875740739022208:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788845932.969651:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c26326680 x1875740739022336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845932.969663:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875740739022208:12345-0@lo:400:kworker.0 Request processed in 107us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845932.969665:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739022336:0@lo:400:kworker.0 00000100:00100000:2.0:1788845932.969675:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788845932.969683:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875740739022208:0@lo:400:kworker.0 00000100:00080000:2.0:1788845932.969696:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788845932.969700:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845932.969710:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739022464:0@lo:400:kworker.0 00000100:00100000:2.0:1788845932.969736:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845932.969761:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739022464 00000100:00100000:2.0:1788845932.969764:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739022464 00000100:00100000:2.0:1788845932.969854:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788845932.969862:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739022464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845932.969895:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739022464:12345-0@lo:400:kworker.0 Request processed in 34us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845932.969901:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788845932.969914:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845932.969931:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739022464:0@lo:400:kworker.0 00000100:00100000:0.0:1788845932.969989:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739022080:0@lo:400:kworker.0 00000100:00100000:0.0:1788845932.969996:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739021952:0@lo:400:kworker.0 00000100:00100000:0.0:1788845932.970021:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845932.970115:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739021952 00000100:00100000:2.0:1788845932.970119:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739021952 00000100:00100000:0.0:1788845932.970371:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788845932.970380:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3310:x1875740739021952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845932.970425:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3310:x1875740739021952:12345-0@lo:400:kworker.0 Request processed in 46us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845932.970431:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788845932.970464:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739021952:0@lo:400:kworker.0 00010000:00010000:2.0:1788845933.222336:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845933.472566:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845933.472663:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845933.472695:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845933.472735:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720116736 00000100:00100000:2.0:1788845933.472753:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720116736 00000100:00100000:2.0:1788845933.472799:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 222 00000100:00100000:2.0:1788845933.472808:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2354:x1875740720116736:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845933.472873:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2354:x1875740720116736:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 66us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845933.472881:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 222 00000100:00100000:0.0:1788845933.479755:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845933.479801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845933.479829:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720116992 00000100:00100000:0.0:1788845933.479838:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720116992 00000100:00100000:0.0:1788845933.479889:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720116864 00000100:00100000:0.0:1788845933.479893:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720116864 00000100:00100000:0.0:1788845933.479917:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:0.0:1788845933.479926:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c20609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8450d7e-d658-40b4-8296-b4731edf9929+5:2354:x1875740720116992:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788845933.479991:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c20609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8450d7e-d658-40b4-8296-b4731edf9929+5:2354:x1875740720116992:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 66us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845933.480000:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:0.0:1788845933.480016:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:0.0:1788845933.480022:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2354:x1875740720116864:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788845933.480046:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2354:x1875740720116864:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845933.480053:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00080000:0.0:1788845933.480071:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845933.483117:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720117120 00000100:00100000:1.0:1788845933.483130:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720117120 00000100:00100000:1.0:1788845933.483199:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720117248 00000100:00100000:1.0:1788845933.483203:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720117248 00000100:00100000:1.0:1788845933.483230:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:1.0:1788845933.483431:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c2060bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8450d7e-d658-40b4-8296-b4731edf9929+5:2350:x1875740720117120:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:1.0:1788845933.483459:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773efca 00000100:00080000:1.0:1788845933.483468:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9a0b06a01000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788845933.483504:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:3.0:1788845933.483842:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845933.483846:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845933.484048:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c2060bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8450d7e-d658-40b4-8296-b4731edf9929+2:2350:x1875740720117120:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 619us (11488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845933.484057:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:1.0:1788845933.484075:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:1.0:1788845933.484089:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c20609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8450d7e-d658-40b4-8296-b4731edf9929+5:2350:x1875740720117248:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:1.0:1788845933.484102:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773efd1 00000100:00080000:1.0:1788845933.484108:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9a0c0744f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788845933.484131:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788845933.484646:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c20609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8450d7e-d658-40b4-8296-b4731edf9929+2:2350:x1875740720117248:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 482us (11875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845933.484654:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00010000:00010000:1.0:1788845933.484681:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845933.484686:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845934.246513:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788845934.334076:0:11162:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe095f8d00 20000000:00000080:0.0:1788845934.334107:0:11162:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a0c3ce0a400 uarg=0000000000000000 20000000:01000000:0.0:1788845934.334139:0:11162:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788845934.334145:0:11162:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788845934.334149:0:11162:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788845934.335541:0:11163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788845934.335713:0:11162:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788845934.345639:0:11162:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788845934.345794:0:11162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.345872:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc39 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.345880:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c773ef8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ef84 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.345886:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773ef99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ef92 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.345892:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773efa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773efa0 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.345899:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c01475800/0x1345bc80c773efbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc71 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.345906:0:11162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.345948:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c01475800/0x1345bc80c773efbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc71 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.345960:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c01475800/0x1345bc80c773efbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc71 expref: 12 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845934.345973:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875740739022592:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845934.346292:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773efa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773efa0 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.346316:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773efa7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773efa0 expref: 18 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845934.346327:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875740739022720:0@lo:104: 00000100:00100000:2.0:1788845934.346364:0:11162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845934.346442:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773ef99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ef92 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.346450:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773ef99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ef92 expref: 18 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845934.346457:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875740739022848:0@lo:104: 00000100:00100000:2.0:1788845934.346737:0:11162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845934.347267:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c773ef8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ef84 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.347276:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c773ef8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ef84 expref: 18 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845934.347286:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da27800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875740739022976:0@lo:104: 00000100:00100000:2.0:1788845934.347310:0:11162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845934.347386:0:8507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739022720 00000100:00100000:1.0:1788845934.347393:0:8507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739022720 00010000:00010000:2.0:1788845934.347496:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc39 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845934.347497:0:8507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739022848 00000100:00100000:3.0:1788845934.347501:0:8507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739022848 00010000:00010000:2.0:1788845934.347505:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc39 expref: 12 pid: 5838 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845934.347512:0:8507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739022976 00000100:00100000:3.0:1788845934.347514:0:8507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739022976 00000100:00100000:2.0:1788845934.347515:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875740739023104:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845934.347525:0:8507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788845934.347533:0:8507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:11162:x1875740739022720:12345-0@lo:104: 00010000:00010000:3.0:1788845934.347543:0:8507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773efa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845934.347570:0:11162:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c34e77e40 going to sleep for 11 seconds 00010000:00010000:3.0:1788845934.347697:0:8507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788845934.347704:0:8507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+5:11162:x1875740739022720:12345-0@lo:104: Request processed in 172us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845934.347711:0:8507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788845934.347736:0:8507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788845934.347743:0:8507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+4:11162:x1875740739022848:12345-0@lo:104: 00010000:00010000:3.0:1788845934.347751:0:8507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ef99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.347786:0:8507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788845934.347864:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788845934.347875:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+4:11162:x1875740739022976:12345-0@lo:104: 00010000:00010000:1.0:1788845934.347918:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ef8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845934.347995:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788845934.348001:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+4:11162:x1875740739022976:12345-0@lo:104: Request processed in 129us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845934.348007:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788845934.348065:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788845934.348071:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773efa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845934.348079:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57600 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:1.0:1788845934.348083:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773efa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845934.348139:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773efa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845934.348146:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773efa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845934.348191:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788845934.348221:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773efa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845934.348263:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845934.348284:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773efa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845934.348292:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57600/0x1345bc80c773efa0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773efa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845934.348334:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788845934.348338:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ef99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845934.348356:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce400 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:1.0:1788845934.348359:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ef99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845934.348365:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ef99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845934.348372:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ef99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845934.348413:0:8507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:11162:x1875740739022848:12345-0@lo:104: Request processed in 669us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845934.348420:0:8507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 10000000:01000000:1.0:1788845934.348423:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788845934.348438:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845934.348442:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ef8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.348448:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcee00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:3.0:1788845934.348452:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ef8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845934.348453:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ef99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.348459:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ef8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845934.348459:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1788845934.348465:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ef8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845934.348470:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788845934.348482:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ef99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.348484:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ef8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.348490:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845934.348495:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ef8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845934.348502:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce400/0x1345bc80c773ef92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ef99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.348511:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcee00/0x1345bc80c773ef84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ef8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845934.348615:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875740739022720:0@lo:104: 00000100:00100000:2.0:1788845934.348640:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875740739022848:0@lo:104: 00000100:00100000:2.0:1788845934.348648:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da27800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875740739022976:0@lo:104: 00010000:00010000:2.0:1788845934.349462:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845934.349723:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845934.349725:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845934.349727:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845934.349743:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739023488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845934.349815:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845934.349853:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845934.349859:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739023360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845934.349881:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845934.350106:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845934.350109:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845934.350111:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845934.350127:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845934.350137:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739023232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788845934.350209:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845934.350255:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739023488 00000100:00100000:3.0:1788845934.350262:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739023488 00010000:00010000:3.0:1788845934.350291:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c773ef8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ef84 expref: 19 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845934.350323:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739023360 00000100:00100000:3.0:1788845934.350326:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739023360 00010000:00010000:3.0:1788845934.350337:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773ef99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ef92 expref: 20 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845934.350346:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739023232 00000100:00100000:3.0:1788845934.350348:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739023232 00010000:00010000:3.0:1788845934.350358:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773efa7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773efa0 expref: 21 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845934.350371:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788845934.350378:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26396050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+21:3308:x1875740739023488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845934.350404:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845934.350410:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c773ef8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ef84 expref: 21 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.350420:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c773ef8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ef84 expref: 21 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.350435:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c773ef8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ef84 expref: 21 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.350447:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845934.350481:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26396050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+20:3308:x1875740739023488:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845934.350487:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788845934.350533:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788845934.350540:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739023360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845934.350546:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845934.350550:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773ef99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ef92 expref: 19 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.350558:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773ef99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ef92 expref: 19 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.350567:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01474a00/0x1345bc80c773ef99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ef92 expref: 19 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.350577:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845934.350599:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:3308:x1875740739023360:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845934.350614:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788845934.350628:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788845934.350640:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:3309:x1875740739023232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845934.350648:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845934.350652:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773efa7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773efa0 expref: 17 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.350661:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773efa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773efa0 expref: 17 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.350670:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773efa7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773efa0 expref: 17 pid: 5840 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.350678:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845934.350707:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:3309:x1875740739023232:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845934.350713:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788845934.350744:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739023360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845934.350753:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739023488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845934.350787:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739023232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845934.351292:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875740739022592:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845934.351378:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845934.351532:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720117376 00000100:00100000:3.0:1788845934.351537:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720117376 00010000:00010000:3.0:1788845934.351560:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c01475800/0x1345bc80c773efbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc71 expref: 13 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845934.351605:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:3.0:1788845934.351613:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a77a96b-0efb-4559-b734-596c51917804+13:2353:x1875740720117376:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845934.351623:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845934.351627:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c01475800/0x1345bc80c773efbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc71 expref: 13 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.351636:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c01475800/0x1345bc80c773efbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc71 expref: 13 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.351648:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01475800/0x1345bc80c773efbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc71 expref: 13 pid: 5840 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845934.351659:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845934.352665:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a77a96b-0efb-4559-b734-596c51917804+12:2353:x1875740720117376:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 1047us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845934.352674:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:3.0:1788845934.356689:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845934.356755:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720117504 00000100:00100000:0.0:1788845934.356763:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720117504 00010000:00010000:0.0:1788845934.356812:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc39 expref: 12 pid: 5838 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845934.356849:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:0.0:1788845934.356858:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a77a96b-0efb-4559-b734-596c51917804+12:2353:x1875740720117504:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845934.356870:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845934.356875:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc39 expref: 12 pid: 5838 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845934.356886:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc39 expref: 12 pid: 5838 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845934.356907:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845934.356915:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845934.356929:0:6705:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845934.356936:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845934.356954:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845934.356960:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845934.356965:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824e00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788845934.356969:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845934.356976:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845934.356985:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845934.356995:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845934.357043:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a77a96b-0efb-4559-b734-596c51917804+12:2353:x1875740720117504:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 185us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845934.357050:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00010000:00010000:2.0:1788845934.359315:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c12f57400/0x1345bc80c773ef7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc39 expref: 11 pid: 5838 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845934.359336:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1875740739023104:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845934.359368:0:11162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.359378:0:11162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.359384:0:11162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845934.359391:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773efd8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788845935.071580:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d8450d7e-d658-40b4-8296-b4731edf9929 00000020:00000080:1.0:1788845935.071590:0:6720:0:(genops.c:885:class_export_put()) final put ffff9a0c34df2800/d8450d7e-d658-40b4-8296-b4731edf9929 00000020:00000080:1.0:1788845935.071628:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c34df2800/d8450d7e-d658-40b4-8296-b4731edf9929 for lustre-OST0000 00000020:00000080:1.0:1788845935.071672:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0b06a01000 for lustre-OST0000 00010000:00010000:1.0:1788845935.270630:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788845935.398279:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788845935.398286:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c2067c000 from 7 10000000:01000000:1.0:1788845935.398290:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845935.398332:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845935.398344:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845935.398363:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845935.398390:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26323800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739023616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788845935.398452:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845935.398499:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c07453c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845935.398542:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739023616 00000100:00100000:2.0:1788845935.398550:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739023616 00000100:00100000:2.0:1788845935.398600:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788845935.398609:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740739023616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845935.398629:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845935.398642:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c02825000/0x1345bc80c773efe6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773efdf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845935.398673:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02825000/0x1345bc80c773efe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773efdf expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845935.398684:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c02825000/0x1345bc80c773efe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773efdf expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845935.398692:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02825000, rc 0) 00000100:00100000:2.0:1788845935.398733:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739023616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845935.398739:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788845935.398894:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26323800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739023616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845935.398907:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773efe6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845935.398916:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773efe6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845935.398964:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26323800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739023744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845935.398988:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845935.399009:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c07453c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845935.399046:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739023744 00000100:00100000:2.0:1788845935.399051:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739023744 00000100:00100000:2.0:1788845935.399090:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788845935.399097:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739023744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845935.399488:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739023744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 391us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845935.399496:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788845935.403718:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26323800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739023744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845935.404475:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26323800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739023872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845935.404545:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845935.404577:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c07453f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845935.404686:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739023872 00000100:00100000:0.0:1788845935.404693:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739023872 00000100:00100000:0.0:1788845935.404879:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788845935.404889:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739023872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845935.405087:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739023872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845935.405103:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788845935.405188:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26323800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739023872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788845935.412821:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788845935.412968:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788845935.412994:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845935.413005:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773efe6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.413017:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773efe6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845935.413027:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788845935.413030:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c3c96b800 from 7 10000000:01000000:0.0:1788845935.413033:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845935.413082:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.413089:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.413101:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845935.413124:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c34be0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739024000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845935.413220:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845935.413264:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845935.413281:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739024000 00000100:00100000:0.0:1788845935.413287:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739024000 00000100:00100000:0.0:1788845935.413323:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788845935.413330:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739024000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845935.413341:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845935.413360:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c3ebce800/0x1345bc80c773eff4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773efed expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.413382:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3ebce800/0x1345bc80c773eff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773efed expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.413392:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c3ebce800/0x1345bc80c773eff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773efed expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.413400:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce800, rc 0) 00000100:00100000:0.0:1788845935.413431:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739024000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845935.413437:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788845935.413480:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c34be0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739024000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845935.413492:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773eff4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.413501:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773eff4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845935.413545:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c34be0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739024128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845935.413567:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845935.413578:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845935.413588:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739024128 00000100:00100000:0.0:1788845935.413591:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739024128 00000100:00100000:0.0:1788845935.413609:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788845935.413622:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739024128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845935.413818:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739024128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845935.413830:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788845935.413858:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c34be0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739024128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845935.413880:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c34be0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739024256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845935.413913:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845935.413924:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845935.413934:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739024256 00000100:00100000:0.0:1788845935.413937:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739024256 00000100:00100000:0.0:1788845935.413954:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788845935.413959:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739024256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845935.414076:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739024256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845935.414082:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788845935.414115:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c34be0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739024256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788845935.422749:0:11208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788845935.425880:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788845935.425915:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845935.425925:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773eff4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.425937:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773eff4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845935.425947:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788845935.425950:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c0942a000 from 7 10000000:01000000:0.0:1788845935.425952:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845935.425988:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.426011:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.426022:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845935.426044:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c34be0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739024384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845935.426119:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845935.426192:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845935.426333:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739024384 00000100:00100000:1.0:1788845935.426340:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739024384 00000100:00100000:1.0:1788845935.426379:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788845935.426387:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739024384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845935.426399:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845935.426419:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01474c00/0x1345bc80c773f002 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773effb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845935.426441:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01474c00/0x1345bc80c773f002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773effb expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845935.426451:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01474c00/0x1345bc80c773f002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773effb expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845935.426459:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474c00, rc 0) 00000100:00100000:1.0:1788845935.426497:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739024384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845935.426504:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788845935.427482:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c34be0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739024384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845935.427501:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f002 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.427512:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773f002 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845935.427585:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c34be0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739024512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845935.427623:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845935.427657:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845935.427707:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739024512 00000100:00100000:1.0:1788845935.427712:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739024512 00000100:00100000:1.0:1788845935.427748:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788845935.427755:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739024512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845935.427981:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739024512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845935.427989:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788845935.428056:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c34be0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739024512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845935.428099:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739024640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845935.428137:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845935.428178:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788845935.428302:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739024640 00000100:00100000:1.0:1788845935.428307:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739024640 00000100:00100000:1.0:1788845935.428338:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788845935.428345:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739024640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845935.428476:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739024640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845935.428482:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788845935.428590:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739024640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788845935.429526:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788845935.430767:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788845935.430790:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845935.430799:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f002 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.430811:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f002 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845935.713834:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845935.713899:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720117632 00000100:00100000:0.0:1788845935.713909:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720117632 00000100:00100000:0.0:1788845935.713961:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 232 00000100:00100000:0.0:1788845935.713972:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+11:5591:x1875740720117632:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845935.713989:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845935.714009:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773f009 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cc9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.714042:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773f009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc9b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.714056:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773f009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc9b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845935.714066:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce000, rc 0) 00000100:00100000:0.0:1788845935.714121:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+12:5591:x1875740720117632:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 151us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845935.714128:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 232 00000100:00100000:0.0:1788845935.719109:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845935.719316:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720117760 00000100:00100000:1.0:1788845935.719324:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720117760 00000100:00100000:1.0:1788845935.719483:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 233 00000100:00100000:1.0:1788845935.719494:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+12:5591:x1875740720117760:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845935.720224:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+12:5591:x1875740720117760:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 729us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845935.720233:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 233 00000100:00100000:0.0:1788845935.724574:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845935.724758:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720117888 00000100:00100000:1.0:1788845935.724767:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720117888 00000100:00100000:1.0:1788845935.724819:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 234 00000100:00100000:1.0:1788845935.724829:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+12:5591:x1875740720117888:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845935.725776:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+12:5591:x1875740720117888:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 943us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845935.725787:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 234 00000100:00100000:1.0:1788845935.741636:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845935.741748:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720118016 00000100:00100000:2.0:1788845935.741756:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720118016 00000100:00100000:2.0:1788845935.741812:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 235 00000100:00100000:2.0:1788845935.741822:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+12:5591:x1875740720118016:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845935.741838:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845935.741855:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f010 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cca2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845935.741986:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cca2 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845935.741999:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cca2 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845935.742007:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02825400, rc 0) 00000100:00100000:2.0:1788845935.742065:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:5591:x1875740720118016:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 244us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845935.742072:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 235 00000100:00100000:0.0:1788845935.746023:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845935.746107:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720118144 00000100:00100000:2.0:1788845935.746119:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720118144 00000100:00100000:2.0:1788845935.747076:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 236 00000100:00100000:2.0:1788845935.747090:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:5591:x1875740720118144:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845935.747407:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:5591:x1875740720118144:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 321us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845935.747415:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 236 00000100:00100000:0.0:1788845935.754540:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845935.754597:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720118272 00000100:00100000:1.0:1788845935.754605:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720118272 00000100:00100000:1.0:1788845935.754654:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 237 00000100:00100000:1.0:1788845935.754673:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:5591:x1875740720118272:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845935.754861:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:5591:x1875740720118272:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 198us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845935.754869:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 237 00000100:00100000:1.0:1788845936.039469:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788845936.039489:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739024768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845936.039560:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845936.039635:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739024768 00000100:00100000:1.0:1788845936.039642:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739024768 00000100:00100000:1.0:1788845936.039691:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788845936.039700:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739024768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845936.039731:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845936.039772:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739024768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845936.039779:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788845936.039817:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c26323100 x1875740739024768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845936.039833:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739024768:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788845936.039919:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788845936.294608:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788845936.599807:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d8450d7e-d658-40b4-8296-b4731edf9929 00000020:00000080:0.0:1788845936.599814:0:7645:0:(genops.c:885:class_export_put()) final put ffff9a0c0744e000/d8450d7e-d658-40b4-8296-b4731edf9929 00000020:00000080:2.0:1788845936.599961:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c0744e000/d8450d7e-d658-40b4-8296-b4731edf9929 for lustre-OST0001 00000020:00000080:2.0:1788845936.600011:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c0744f000 for lustre-OST0001 00010000:00010000:0.0:1788845937.319312:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788845937.527929:0:11361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788845938.086444:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739025024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845938.086538:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845938.086615:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739025024 00000100:00100000:2.0:1788845938.086623:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739025024 00000100:00080000:3.0:1788845938.086664:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845938.086688:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788845938.086797:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739024896:0@lo:400:kworker.0 00000100:00100000:0.0:1788845938.086833:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845938.086939:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739024896 00000100:00100000:3.0:1788845938.086944:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739024896 00000100:00100000:3.0:1788845938.086974:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788845938.086983:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3310:x1875740739024896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845938.087035:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3310:x1875740739024896:12345-0@lo:400:kworker.0 Request processed in 53us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845938.087053:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788845938.087116:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739024896:0@lo:400:kworker.0 00000100:00100000:2.0:1788845938.087278:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739025024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845938.087305:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845938.087340:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739025024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (803us total) trans 0 rc 0/0 00010000:00080000:3.0:1788845938.087404:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3da26300 x1875740739025024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845938.087420:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739025024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845938.088608:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740739025152:0@lo:400:kworker.0 00000100:00100000:3.0:1788845938.088620:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739025280:0@lo:400:kworker.0 00000100:00100000:3.0:1788845938.088673:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845938.088716:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845938.088722:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739025408:0@lo:400:kworker.0 00000100:00100000:3.0:1788845938.088750:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845938.088779:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739025280 00000100:00100000:3.0:1788845938.088785:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739025280 00000100:00100000:3.0:1788845938.088828:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788845938.088837:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739025280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845938.088878:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739025280:12345-0@lo:400:kworker.0 Request processed in 42us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845938.088885:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788845938.088918:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845938.088942:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739025280:0@lo:400:kworker.0 00000100:00100000:3.0:1788845938.088979:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739025536:0@lo:400:kworker.0 00000100:00100000:3.0:1788845938.089003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845938.089031:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739025536 00000100:00100000:3.0:1788845938.089034:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739025536 00000100:00100000:3.0:1788845938.089075:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788845938.089094:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739025536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845938.089127:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739025536:12345-0@lo:400:kworker.0 Request processed in 34us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845938.089133:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788845938.089167:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845938.089185:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739025536:0@lo:400:kworker.0 00000100:00100000:3.0:1788845938.089314:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739025408 00000100:00100000:3.0:1788845938.089319:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739025408 00000100:00100000:3.0:1788845938.089352:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788845938.089360:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c077e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739025408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845938.089400:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c077e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739025408:12345-0@lo:400:kworker.0 Request processed in 41us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845938.089408:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788845938.089414:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845938.089459:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739025152 00000100:00100000:1.0:1788845938.089465:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739025152 00000100:00100000:1.0:1788845938.089494:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788845938.089503:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740739025152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845938.089549:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740739025152:12345-0@lo:400:kworker.0 Request processed in 47us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845938.089556:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788845938.089596:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740739025152:0@lo:400:kworker.0 00000100:00080000:3.0:1788845938.089612:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788845938.089636:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c26320700 x1875740739025408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845938.089648:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739025408:0@lo:400:kworker.0 00000100:00100000:2.0:1788845938.097188:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1788845938.344385:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845938.590529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845938.590568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845938.590602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845938.590646:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720118528 00000100:00100000:1.0:1788845938.590655:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720118528 00000100:00100000:2.0:1788845938.590658:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720118400 00000100:00100000:2.0:1788845938.590662:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720118400 00000100:00100000:2.0:1788845938.590702:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 239 00000100:00100000:2.0:1788845938.590712:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2351:x1875740720118400:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845938.590786:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2351:x1875740720118400:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845938.590793:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 239 00000100:00100000:1.0:1788845938.590953:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720118656 00000100:00100000:1.0:1788845938.590957:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720118656 00000100:00100000:1.0:1788845938.590987:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:1.0:1788845938.590994:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2351:x1875740720118528:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845938.591052:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2351:x1875740720118528:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 58us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845938.591059:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:1.0:1788845938.591074:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:1.0:1788845938.591081:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8450d7e-d658-40b4-8296-b4731edf9929+5:2351:x1875740720118656:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845938.591106:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8450d7e-d658-40b4-8296-b4731edf9929+5:2351:x1875740720118656:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 26us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845938.591112:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00080000:1.0:1788845938.591128:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788845939.366387:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788845940.255888:0:11460:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:38:59 (1788845939) === 00010000:00010000:0.0:1788845940.390257:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845940.496484:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.496531:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845940.496611:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720118784 00000100:00100000:3.0:1788845940.496620:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720118784 00000100:00100000:3.0:1788845940.496696:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1788845940.496708:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720118784:12345-192.168.206.48@tcp:41:mkdir.0 00000100:00100000:2.0:1788845940.496736:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720118912 00000100:00100000:2.0:1788845940.496743:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720118912 00000004:00000024:3.0:1788845940.496759:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788845940.496779:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:2.0:1788845940.496789:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4592a189-21d8-449a-9335-07bfe0dc7877+7:9675:x1875740720118912:12345-192.168.206.48@tcp:700:mkdir.0 00000100:00080000:1.0:1788845940.496859:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845940.496931:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2353:x1875740720118784:12345-192.168.206.48@tcp:41:mkdir.0 Request processed in 225us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845940.496938:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1788845940.501782:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4592a189-21d8-449a-9335-07bfe0dc7877+6:9675:x1875740720118912:12345-192.168.206.48@tcp:700:mkdir.0 Request processed in 4983us (5239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845940.501801:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1788845940.528306:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845940.528474:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720119168 00000100:00100000:2.0:1788845940.528484:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720119168 00000100:00100000:2.0:1788845940.528575:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:2.0:1788845940.528587:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:9675:x1875740720119168:12345-192.168.206.48@tcp:36:mkdir.0 00010000:00010000:2.0:1788845940.528635:0:7134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845940.528660:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773eef8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc24 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.528692:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:2.0:1788845940.528701:0:7134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845940.529080:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825e00/0x1345bc80c773f017 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.529094:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825e00/0x1345bc80c773f017 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.529103:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825e00/0x1345bc80c773f017 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.529226:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824400/0x1345bc80c773f01e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.529234:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824400/0x1345bc80c773f01e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.529240:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824400/0x1345bc80c773f01e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845940.531323:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788845940.531340:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825e00/0x1345bc80c773f017 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.531351:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825e00/0x1345bc80c773f017 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.531358:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825e00/0x1345bc80c773f017 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.531364:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845940.531375:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825e00/0x1345bc80c773f017 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.531383:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825e00/0x1345bc80c773f017 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.531398:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4fd00) 00010000:00010000:2.0:1788845940.531401:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845940.531405:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825e00/0x1345bc80c773f017 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.531411:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825e00/0x1345bc80c773f017 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845940.531431:0:7134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000930bef94 reply state 00000000c8f2372c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824400/0x1345bc80c773f01e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845940.531439:0:7134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845940.531575:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+7:9675:x1875740720119168:12345-192.168.206.48@tcp:36:mkdir.0 Request processed in 2988us (3275us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788845940.531584:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00010000:00010000:3.0:1788845940.535851:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824400/0x1345bc80c773f01e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.535871:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824400/0x1345bc80c773f01e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.535879:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824400/0x1345bc80c773f01e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.535886:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845940.535891:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824400/0x1345bc80c773f01e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.535898:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824400/0x1345bc80c773f01e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.535917:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a0c04c4f400) 00010000:00010000:3.0:1788845940.535921:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845940.535926:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824400/0x1345bc80c773f01e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.535932:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824400/0x1345bc80c773f01e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845940.551610:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845940.551715:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720119296 00000100:00100000:0.0:1788845940.551726:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720119296 00000100:00100000:0.0:1788845940.551781:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:0.0:1788845940.551791:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:9677:x1875740720119296:12345-192.168.206.48@tcp:101:chmod.0 00010000:00010000:0.0:1788845940.551811:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845940.551834:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f025 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cca9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.551891:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f02c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.551905:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f02c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.551917:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f02c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845940.551948:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788845940.551952:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845940.552130:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f02c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.552426:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f025 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cca9 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.552446:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f02c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cca9 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.552471:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:0.0:1788845940.552474:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845940.552477:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce400, rc 0) 00000100:00100000:0.0:1788845940.552592:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+7:9677:x1875740720119296:12345-192.168.206.48@tcp:101:chmod.0 Request processed in 802us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845940.552600:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1788845940.560259:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.560379:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720119552 00000100:00100000:1.0:1788845940.560388:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720119552 00000100:00100000:1.0:1788845940.560442:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:1.0:1788845940.560451:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+7:9677:x1875740720119552:12345-192.168.206.48@tcp:36:chmod.0 00010000:00010000:1.0:1788845940.560501:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845940.560538:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f02c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cca9 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.560556:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:1.0:1788845940.560568:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845940.560592:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f033 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.560604:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f033 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.560612:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f033 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845940.560924:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001169c91 reply state 00000000828e4f95 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f033 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845940.560933:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788845940.560941:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788845940.561022:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+8:9677:x1875740720119552:12345-192.168.206.48@tcp:36:chmod.0 Request processed in 570us (777us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788845940.561030:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00010000:00010000:3.0:1788845940.563870:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f033 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.563889:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f033 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.563923:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f033 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.563929:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845940.563934:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f033 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.563942:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f033 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.563957:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382400) 00010000:00010000:3.0:1788845940.563960:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788845940.563965:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f033 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.563972:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f033 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845940.579583:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845940.579686:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720119680 00000100:00100000:0.0:1788845940.579696:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720119680 00000100:00100000:0.0:1788845940.579750:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:0.0:1788845940.579759:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+7:9678:x1875740720119680:12345-192.168.206.48@tcp:101:chown.0 00010000:00010000:0.0:1788845940.579779:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845940.579797:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f03a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ccb0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.579856:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f041 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.579869:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.579879:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845940.579909:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788845940.579912:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845940.579943:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.579982:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f03a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccb0 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.579998:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccb0 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.580006:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:0.0:1788845940.580009:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845940.580012:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce400, rc 0) 00000100:00100000:0.0:1788845940.580075:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+8:9678:x1875740720119680:12345-192.168.206.48@tcp:101:chown.0 Request processed in 316us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845940.580082:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1788845940.582334:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.582411:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720119808 00000100:00100000:1.0:1788845940.582419:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720119808 00000100:00100000:1.0:1788845940.582489:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:1.0:1788845940.582499:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+8:9678:x1875740720119808:12345-192.168.206.48@tcp:101:chown.0 00010000:00010000:1.0:1788845940.582522:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845940.582541:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ccb7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582619:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f04f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582632:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f04f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582643:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f04f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582656:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f056 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582663:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582669:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582738:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f05d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582745:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582752:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845940.582776:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788845940.582779:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845940.582796:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f05d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582816:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f04f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582822:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f04f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582828:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f04f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582833:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845940.582837:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f04f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582844:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f04f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582855:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:1.0:1788845940.582858:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845940.582862:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f04f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582868:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f04f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582880:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582886:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f056 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582891:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582901:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845940.582904:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582911:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f056 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582919:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a0c10382700) 00010000:00010000:1.0:1788845940.582921:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845940.582924:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f056 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582929:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f056 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582956:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccb7 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582970:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f05d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccb7 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.582978:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a0c10382900) 00010000:00010000:1.0:1788845940.582981:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845940.582983:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474200, rc 0) 00000100:00100000:1.0:1788845940.583035:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+9:9678:x1875740720119808:12345-192.168.206.48@tcp:101:chown.0 Request processed in 538us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845940.583042:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:2.0:1788845940.586202:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845940.586426:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720120064 00000100:00100000:0.0:1788845940.586435:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720120064 00000100:00100000:0.0:1788845940.586627:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:0.0:1788845940.586638:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+9:9678:x1875740720120064:12345-192.168.206.48@tcp:36:chown.0 00010000:00010000:0.0:1788845940.586688:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845940.586714:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f05d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccb7 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.586809:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a0c10382900) 00010000:00010000:0.0:1788845940.586887:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845940.586914:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f064 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.586929:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.586956:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845940.616070:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019a64f44 reply state 000000003f2aa7b3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845940.616086:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788845940.616100:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000001:00080000:1.0:1788845940.616265:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00080000:2.0:1788845940.616571:0:5846:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788845940.616594:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+7:9678:x1875740720120064:12345-192.168.206.48@tcp:36:chown.0 Request processed in 29954us (30592us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788845940.616602:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00010000:00010000:3.0:1788845940.617356:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f064 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.617368:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f064 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.617377:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f064 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.617398:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845940.617403:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f064 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.617411:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f064 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.617427:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a0c11677c00) 00010000:00010000:3.0:1788845940.617431:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788845940.617435:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f064 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.617441:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f064 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845940.631207:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.631521:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720120192 00000100:00100000:1.0:1788845940.631530:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720120192 00000100:00100000:1.0:1788845940.631588:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:1.0:1788845940.631599:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:9679:x1875740720120192:12345-192.168.206.48@tcp:101:touch.500 00010000:00010000:1.0:1788845940.631622:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845940.631641:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f06b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ccbe expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845940.636433:0:7134:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4622us 00010000:00010000:1.0:1788845940.660577:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f072 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.660600:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f072 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.660612:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f072 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.660628:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f079 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.660635:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.660642:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661399:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f080 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661410:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661424:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845940.661448:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788845940.661451:0:7134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845940.661485:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661498:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f072 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661504:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f072 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661511:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f072 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661517:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845940.661521:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f072 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661528:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f072 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661539:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:1.0:1788845940.661543:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845940.661547:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661553:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661575:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661580:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f079 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661585:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f079 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661590:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845940.661593:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f079 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661598:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f079 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661605:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a0c10382200) 00010000:00010000:1.0:1788845940.661607:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845940.661609:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f079 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661615:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f079 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661647:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f06b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccbe expref: 8 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661660:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccbe expref: 7 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.661677:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a0c10382700) 00010000:00010000:1.0:1788845940.661680:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788845940.661682:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474200, rc 0) 00000100:00100000:1.0:1788845940.663572:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+7:9679:x1875740720120192:12345-192.168.206.48@tcp:101:touch.500 Request processed in 31966us (32364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845940.663584:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:2.0:1788845940.677497:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.677875:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720120448 00000100:00100000:1.0:1788845940.677885:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720120448 00000100:00100000:1.0:1788845940.677973:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:1.0:1788845940.677983:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:9679:x1875740720120448:12345-192.168.206.48@tcp:101:touch.500 00010000:00010000:1.0:1788845940.678003:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845940.678022:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f087 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ccc5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.678300:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f08e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.678315:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f08e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.678325:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f08e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.678338:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f095 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.678345:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f095 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.678365:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f095 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845940.679052:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788845940.679381:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773f09c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.679393:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773f09c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.679400:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773f09c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.679434:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f08e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.679440:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f08e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.679446:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f08e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.679451:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845940.679454:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f08e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.679460:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f08e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.679470:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a0c10382700) 00010000:00010000:1.0:1788845940.679472:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845940.679483:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f08e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.679488:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f08e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845940.679500:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063e13d71 reply state 00000000f0c4ba1c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f095 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845940.679507:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788845940.679535:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f087 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccc5 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.679547:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773f09c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccc5 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.679554:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:1.0:1788845940.679556:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845940.679558:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01400, rc 0) 00000100:00100000:1.0:1788845940.679637:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+10:9679:x1875740720120448:12345-192.168.206.48@tcp:101:touch.500 Request processed in 1655us (2149us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788845940.679646:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:2.0:1788845940.683650:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.684120:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720120704 00000100:00100000:1.0:1788845940.684129:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720120704 00000100:00100000:1.0:1788845940.684207:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:1.0:1788845940.684226:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+10:9679:x1875740720120704:12345-192.168.206.48@tcp:36:touch.500 00010000:00010000:1.0:1788845940.684282:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845940.684306:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773f09c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccc5 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.684340:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:1.0:1788845940.684349:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845940.684383:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f0aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.684394:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f0aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.684404:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f0aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845940.684511:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005187eeaa reply state 000000000390e391 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f0aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845940.684519:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788845940.684593:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+11:9679:x1875740720120704:12345-192.168.206.48@tcp:36:touch.500 Request processed in 369us (951us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788845940.684601:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00010000:00010000:3.0:1788845940.685594:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f095 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.685605:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f095 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.685612:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f095 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.685618:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845940.685622:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f095 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.685629:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f095 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.685657:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff9a0c10382200) 00010000:00010000:3.0:1788845940.685660:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845940.685664:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f095 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.685670:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f095 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.689398:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f0aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.689416:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f0aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.689424:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f0aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.689431:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845940.689436:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f0aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.689444:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f0aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.689461:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a0c10382b00) 00010000:00010000:3.0:1788845940.689463:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845940.689468:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f0aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.689473:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f0aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845940.690641:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845940.691189:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720120832 00000100:00100000:0.0:1788845940.691199:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720120832 00000100:00100000:0.0:1788845940.691268:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:0.0:1788845940.691278:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+9:9679:x1875740720120832:12345-192.168.206.48@tcp:101:touch.500 00010000:00010000:0.0:1788845940.691302:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845940.691321:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f0b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cccc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.691375:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f0b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cccc expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.691389:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f0b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cccc expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845940.691406:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a0c11677e00) 00010000:00010000:0.0:1788845940.691409:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788845940.691412:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce200, rc 0) 00000100:00100000:0.0:1788845940.691460:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+10:9679:x1875740720120832:12345-192.168.206.48@tcp:101:touch.500 Request processed in 184us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845940.691467:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:0.0:1788845940.695047:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.695341:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720120960 00000100:00100000:1.0:1788845940.695351:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720120960 00000100:00100000:1.0:1788845940.695394:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:1.0:1788845940.695404:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1875740720120960:12345-192.168.206.48@tcp:8:touch.500 00010000:00080000:1.0:1788845940.695430:0:8094:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:1.0:1788845940.695457:0:8094:0:(genops.c:1385:class_connect()) connect: client 4592a189-21d8-449a-9335-07bfe0dc7877, cookie 0x1345bc80c773f0b8 00002000:00100000:1.0:1788845940.695468:0:8094:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4592a189-21d8-449a-9335-07bfe0dc7877/ffff9a0c2067c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788845940.695488:0:8094:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788845940.695687:0:8094:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788845940.695716:0:8094:0:(import.c:65:import_set_state_nolock()) ffff9a0c34df2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845940.695792:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2350:x1875740720120960:12345-192.168.206.48@tcp:8:touch.500 Request processed in 388us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845940.695800:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:2.0:1788845940.698237:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.698387:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720121088 00000100:00100000:1.0:1788845940.698396:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720121088 00000100:00100000:1.0:1788845940.698465:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1788845940.698474:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+6:0:x1875740720121088:12345-192.168.206.48@tcp:2:touch.500 00000100:00080000:3.0:1788845940.702264:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788845940.728910:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1788845940.728924:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4592a189-21d8-449a-9335-07bfe0dc7877 00000100:00100000:1.0:1788845940.729147:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:0:x1875740720121088:12345-192.168.206.48@tcp:2:touch.500 Request processed in 30669us (30913us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788845940.729232:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:3.0:1788845940.734680:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.734859:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720121344 00000100:00100000:1.0:1788845940.734868:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720121344 00000100:00100000:1.0:1788845940.734972:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1788845940.734981:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+10:9679:x1875740720121344:12345-192.168.206.48@tcp:35:touch.500 00000100:00100000:1.0:1788845940.735365:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+11:9679:x1875740720121344:12345-192.168.206.48@tcp:35:touch.500 Request processed in 384us (692us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788845940.735373:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:0.0:1788845940.752275:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.752428:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720121472 00000100:00100000:1.0:1788845940.752437:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720121472 00000100:00100000:1.0:1788845940.752496:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:1.0:1788845940.752506:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+11:9680:x1875740720121472:12345-192.168.206.48@tcp:101:rm.0 00010000:00010000:1.0:1788845940.752532:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845940.752552:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773f0bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ccd3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.752627:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f0c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.752642:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.752653:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845940.752684:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788845940.752688:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845940.752721:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.752744:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773f0bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccd3 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.752770:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f0c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccd3 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.752779:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a0c10382700) 00010000:00010000:1.0:1788845940.752781:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845940.752785:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00e00, rc 0) 00000100:00100000:1.0:1788845940.752835:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+12:9680:x1875740720121472:12345-192.168.206.48@tcp:101:rm.0 Request processed in 331us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845940.752842:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:0.0:1788845940.759555:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845940.759633:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720121728 00000100:00100000:2.0:1788845940.759643:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720121728 00000100:00100000:2.0:1788845940.759699:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:2.0:1788845940.759708:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+12:9680:x1875740720121728:12345-192.168.206.48@tcp:101:rm.0 00010000:00010000:2.0:1788845940.759728:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845940.759746:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824e00/0x1345bc80c773f0cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ccda expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845940.759826:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788845940.759991:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824e00/0x1345bc80c773f0cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccda expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.760006:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:2.0:1788845940.760009:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845940.760019:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824e00/0x1345bc80c773f0cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccda expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.760032:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02824e00, rc 0) 00000100:00100000:2.0:1788845940.761223:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+13:9680:x1875740720121728:12345-192.168.206.48@tcp:101:rm.0 Request processed in 1498us (1657us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788845940.761233:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:3.0:1788845940.764283:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845940.764401:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720121856 00000100:00100000:2.0:1788845940.764411:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720121856 00000100:00100000:2.0:1788845940.764466:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:2.0:1788845940.764489:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+13:9680:x1875740720121856:12345-192.168.206.48@tcp:37:rm.0 00000100:00100000:2.0:1788845940.768728:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+13:9680:x1875740720121856:12345-192.168.206.48@tcp:37:rm.0 Request processed in 4231us (4444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845940.768739:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:0.0:1788845940.779003:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.779089:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720122112 00000100:00100000:1.0:1788845940.779098:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720122112 00000100:00100000:1.0:1788845940.779198:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1788845940.779217:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08dc0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+13:9680:x1875740720122112:12345-192.168.206.48@tcp:35:rm.0 00000100:00100000:1.0:1788845940.779406:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08dc0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+14:9680:x1875740720122112:12345-192.168.206.48@tcp:35:rm.0 Request processed in 200us (413us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788845940.779413:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:3.0:1788845940.785535:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845940.785690:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720122368 00000100:00100000:2.0:1788845940.785700:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720122368 00000100:00100000:2.0:1788845940.785809:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:2.0:1788845940.785821:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+14:9680:x1875740720122368:12345-192.168.206.48@tcp:101:rm.0 00010000:00010000:2.0:1788845940.785847:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845940.785867:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824e00/0x1345bc80c773f0db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cce1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.785961:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f0e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.785976:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f0e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.785989:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f0e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845940.786000:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788845940.786117:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824e00/0x1345bc80c773f0db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cce1 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.786138:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f0e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cce1 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.786599:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a0c10382700) 00010000:00010000:2.0:1788845940.786602:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788845940.786605:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02824000, rc 0) 00000100:00100000:2.0:1788845940.786664:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+16:9680:x1875740720122368:12345-192.168.206.48@tcp:101:rm.0 Request processed in 845us (1136us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788845940.786672:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:0.0:1788845940.788602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845940.788985:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720122496 00000100:00100000:2.0:1788845940.788994:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720122496 00000100:00100000:2.0:1788845940.789050:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:2.0:1788845940.789060:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+16:9680:x1875740720122496:12345-192.168.206.48@tcp:41:rm.0 00000004:00000024:2.0:1788845940.789111:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788845940.789362:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+16:9680:x1875740720122496:12345-192.168.206.48@tcp:41:rm.0 Request processed in 302us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845940.789370:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:0.0:1788845940.791477:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.791564:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720122624 00000100:00100000:1.0:1788845940.791574:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720122624 00000100:00100000:1.0:1788845940.791626:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:1.0:1788845940.791635:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+16:9680:x1875740720122624:12345-192.168.206.48@tcp:101:rm.0 00010000:00010000:1.0:1788845940.791655:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845940.791674:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773f0f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cce8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.791734:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773f0f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.791749:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773f0f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.791771:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773f0f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.791786:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f0fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.791794:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f0fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.791801:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f0fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.791916:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f105 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.791925:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.791932:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845940.791961:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788845940.791966:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845940.791985:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.791997:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792006:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773f0f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792012:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773f0f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792018:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773f0f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792024:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845940.792028:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773f0f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792036:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773f0f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792055:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a0c10382700) 00010000:00010000:1.0:1788845940.792058:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845940.792062:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773f0f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792068:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773f0f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792081:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f0fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792086:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f0fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792091:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f0fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792096:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845940.792098:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f0fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792103:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f0fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792123:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff9a0c10382e00) 00010000:00010000:1.0:1788845940.792125:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845940.792129:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f0fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792134:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f0fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792221:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773f0f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cce8 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792235:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f105 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cce8 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.792243:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a0c11677e00) 00010000:00010000:1.0:1788845940.792245:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845940.792248:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00000, rc 0) 00000100:00100000:1.0:1788845940.792298:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+17:9680:x1875740720122624:12345-192.168.206.48@tcp:101:rm.0 Request processed in 664us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845940.792305:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:3.0:1788845940.795266:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.795405:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720122880 00000100:00100000:1.0:1788845940.795415:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720122880 00000100:00100000:1.0:1788845940.795466:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:1.0:1788845940.795476:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+17:9680:x1875740720122880:12345-192.168.206.48@tcp:36:rm.0 00010000:00010000:1.0:1788845940.795526:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788845940.795551:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f105 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cce8 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.795573:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f0b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cccc expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.795582:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a0c11677e00) 00010000:00010000:1.0:1788845940.795595:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f0c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccd3 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.795622:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a0c10382700) 00010000:00010000:1.0:1788845940.795625:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845940.795644:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f10c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.795656:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f10c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.795665:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f10c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.795678:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f113 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.795686:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.795692:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.795843:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f11a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.795853:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f11a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.795860:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f11a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788845940.796584:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788845940.796596:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 273013441734ns, next at 274013439412ns, rc = 0 00010000:00010000:1.0:1788845940.796664:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f121 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796676:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796684:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f121 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796691:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f121 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796696:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f121 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796702:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f121 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796728:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788845940.796746:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f11a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796752:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f11a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796758:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f11a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796764:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845940.796767:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f11a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796774:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f11a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796792:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a0c10382300) 00010000:00010000:1.0:1788845940.796794:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788845940.796798:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f11a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796804:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f11a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796820:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f10c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796825:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f10c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796831:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f10c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796835:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845940.796838:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f10c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796843:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f10c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796848:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a0c10382700) 00010000:00010000:1.0:1788845940.796851:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845940.796853:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f10c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.796858:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f10c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845940.796875:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b9dc01e reply state 0000000092d0e1ff transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845940.796883:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788845940.796966:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+16:9680:x1875740720122880:12345-192.168.206.48@tcp:36:rm.0 Request processed in 1488us (1704us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788845940.796974:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00010000:00010000:2.0:1788845940.797202:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845940.797218:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f121 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.797225:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00c00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:2.0:1788845940.797229:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f121 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.797235:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f121 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.797246:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a0c10382300) 00010000:00010000:2.0:1788845940.797248:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788845940.797258:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f121 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.797264:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f121 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845940.797279:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845940.797281:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845940.797283:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845940.798744:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.798758:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f113 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.798765:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.798770:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845940.798775:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.798782:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f113 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.798795:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff9a0c10382000) 00010000:00010000:3.0:1788845940.798798:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845940.798801:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f113 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.798808:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f113 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845940.801428:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.801649:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720123136 00000100:00100000:1.0:1788845940.801659:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720123136 00000100:00100000:1.0:1788845940.801743:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1788845940.801754:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+15:9680:x1875740720123136:12345-192.168.206.48@tcp:35:rm.0 00000100:00100000:1.0:1788845940.801984:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+16:9680:x1875740720123136:12345-192.168.206.48@tcp:35:rm.0 Request processed in 231us (563us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788845940.801991:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:0.0:1788845940.807482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845940.807578:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720123392 00000100:00100000:1.0:1788845940.807588:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720123392 00000100:00100000:1.0:1788845940.807689:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:1.0:1788845940.807700:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+16:9680:x1875740720123392:12345-192.168.206.48@tcp:36:rm.0 00010000:00010000:1.0:1788845940.807758:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788845940.807783:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f0e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cce1 expref: 16 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.807805:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f080 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccbe expref: 15 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.807816:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a0c10382700) 00010000:00010000:1.0:1788845940.807847:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f041 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccb0 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.807856:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:1.0:1788845940.807863:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845940.807883:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f128 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.807896:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f128 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.807905:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f128 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.807917:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f12f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.807924:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f12f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.807930:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f12f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808149:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f136 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808197:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f136 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808205:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f136 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845940.808748:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788845940.808770:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f136 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808779:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f136 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808785:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f136 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808792:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845940.808797:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f136 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808804:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f136 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808814:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a0c10382500) 00010000:00010000:1.0:1788845940.808817:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788845940.808820:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f136 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808826:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f136 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808845:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f128 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808851:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f128 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808856:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f128 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808860:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845940.808869:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f128 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808875:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f128 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808884:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:1.0:1788845940.808886:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845940.808889:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f128 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845940.808894:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f128 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845940.808906:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000421abfe7 reply state 00000000a572b554 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f12f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845940.808914:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788845940.808997:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+15:9680:x1875740720123392:12345-192.168.206.48@tcp:36:rm.0 Request processed in 1297us (1522us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788845940.809004:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00010000:00010000:3.0:1788845940.813005:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f12f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.813023:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f12f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.813032:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f12f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.813038:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845940.813043:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f12f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.813051:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f12f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.813067:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a0c10382100) 00010000:00010000:3.0:1788845940.813070:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845940.813074:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f12f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845940.813080:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f12f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845941.158669:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739025664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845941.158754:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845941.159287:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739025664 00000100:00100000:1.0:1788845941.159295:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739025664 00000100:00100000:1.0:1788845941.159363:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788845941.159372:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739025664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845941.159399:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845941.159452:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739025664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845941.159478:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788845941.159520:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c26320700 x1875740739025664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845941.159559:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739025664:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788845941.159880:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788845941.419050:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845942.438410:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845943.206490:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739025792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845943.206553:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845943.206665:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739025792 00000100:00100000:2.0:1788845943.206673:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739025792 00000100:00100000:2.0:1788845943.206742:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788845943.206751:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739025792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845943.206785:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845943.206837:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739025792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845943.206844:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788845943.207054:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788845943.207184:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b075e0000 x1875740739025792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845943.207216:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739025792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845943.208390:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739026304:0@lo:400:kworker.0 00000100:00100000:0.0:1788845943.208441:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845943.208481:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788845943.208487:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739025920:0@lo:400:kworker.0 00000100:00100000:0.0:1788845943.208513:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845943.208531:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739026432:0@lo:400:kworker.0 00000100:00100000:0.0:1788845943.208574:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845943.208649:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739026048:0@lo:400:kworker.0 00000100:00100000:2.0:1788845943.208678:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845943.208713:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845943.208727:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739026176:0@lo:400:kworker.0 00000100:00100000:2.0:1788845943.208749:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845943.208776:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739026432 00000100:00100000:2.0:1788845943.208782:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739026432 00000100:00100000:2.0:1788845943.208821:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739026048 00000100:00100000:2.0:1788845943.208824:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739026048 00000100:00100000:2.0:1788845943.208847:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739026176 00000100:00100000:2.0:1788845943.208850:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739026176 00000100:00100000:2.0:1788845943.208865:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788845943.208872:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739026432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845943.208916:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739026432:12345-0@lo:400:kworker.0 Request processed in 44us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845943.208923:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788845943.208939:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788845943.208945:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739026048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845943.209055:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739026048:12345-0@lo:400:kworker.0 Request processed in 110us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845943.209061:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788845943.209076:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788845943.209082:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739026176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845943.209109:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739026176:12345-0@lo:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845943.209114:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788845943.209170:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739026176:0@lo:400:kworker.0 00000100:00100000:2.0:1788845943.209183:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739026048:0@lo:400:kworker.0 00000100:00100000:2.0:1788845943.209225:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739026432:0@lo:400:kworker.0 00000100:00100000:3.0:1788845943.209652:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739026304 00000100:00100000:3.0:1788845943.209658:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739026304 00000100:00100000:3.0:1788845943.209707:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788845943.209715:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739026304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845943.209789:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739026304:12345-0@lo:400:kworker.0 Request processed in 75us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845943.209796:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788845943.209816:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739025920 00000100:00100000:3.0:1788845943.209819:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739025920 00000100:00100000:3.0:1788845943.209850:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788845943.209855:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739025920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845943.209883:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739025920:12345-0@lo:400:kworker.0 Request processed in 27us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845943.209888:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:3.0:1788845943.209909:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845943.209913:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845943.210273:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739025920:0@lo:400:kworker.0 00010000:00080000:0.0:1788845943.210287:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c26326d80 x1875740739026304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845943.210299:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739026304:0@lo:400:kworker.0 00010000:00010000:1.0:1788845943.462358:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845943.718974:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845943.719017:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845943.719092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845943.719118:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845943.719184:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720123648 00000100:00100000:0.0:1788845943.719204:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720123648 00000100:00100000:3.0:1788845943.719320:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720123520 00000100:00100000:3.0:1788845943.719324:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720123520 00000100:00100000:3.0:1788845943.719361:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 241 00000100:00100000:3.0:1788845943.719370:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:2353:x1875740720123520:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845943.719445:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:2353:x1875740720123520:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 76us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845943.719453:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 241 00000100:00080000:3.0:1788845943.719481:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845943.719701:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720123904 00000100:00100000:2.0:1788845943.719707:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720123904 00000100:00080000:3.0:1788845943.719735:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845943.719923:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:2.0:1788845943.719935:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8450d7e-d658-40b4-8296-b4731edf9929+5:2353:x1875740720123904:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845943.721519:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720123776 00000100:00100000:1.0:1788845943.721533:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720123776 00000100:00100000:1.0:1788845943.721597:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:1.0:1788845943.721607:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2353:x1875740720123776:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845943.721708:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8450d7e-d658-40b4-8296-b4731edf9929+5:2353:x1875740720123904:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 1774us (2586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845943.721727:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00080000:2.0:1788845943.721780:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845943.721787:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2353:x1875740720123776:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 179us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845943.721796:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:0.0:1788845943.722189:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:0.0:1788845943.722211:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+14:2353:x1875740720123648:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788845943.722391:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+14:2353:x1875740720123648:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 182us (3297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845943.722400:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 81 00000001:02000400:0.0:1788845943.991141:0:11611:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788845944.490426:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788845944.755596:0:11659:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe640646d0 20000000:00000080:3.0:1788845944.755614:0:11659:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a0c3d6a3000 uarg=0000000000000000 20000000:01000000:3.0:1788845944.755645:0:11659:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788845944.755651:0:11659:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788845944.755655:0:11659:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788845944.757091:0:11660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788845944.757600:0:11659:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788845944.768082:0:11659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788845944.768174:0:11659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788845944.768250:0:11659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788845944.768270:0:11659:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788845944.768288:0:11659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.768306:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c02825000/0x1345bc80c773efe6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773efdf expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.768315:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c3ebce800/0x1345bc80c773eff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773efed expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.768336:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c01474c00/0x1345bc80c773f002 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773effb expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.768346:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773f009 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc9b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.768354:0:11659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f010 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cca2 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.768362:0:11659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.768401:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cca2 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.768431:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f010 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cca2 expref: 12 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845944.769133:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875740739026560:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845944.769270:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773f009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc9b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.769281:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773f009 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc9b expref: 12 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845944.769291:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875740739026688:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845944.769334:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c01474c00/0x1345bc80c773f002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773effb expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.769342:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c01474c00/0x1345bc80c773f002 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773effb expref: 18 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845944.769352:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875740739026816:0@lo:104: 00000100:00100000:2.0:1788845944.769387:0:11659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845944.769494:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c3ebce800/0x1345bc80c773eff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773efed expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.769503:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c3ebce800/0x1345bc80c773eff4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773efed expref: 18 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845944.769511:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875740739026944:0@lo:104: 00000100:00100000:2.0:1788845944.769531:0:11659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845944.772105:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845944.772232:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720124032 00000100:00100000:1.0:1788845944.772241:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720124032 00010000:00010000:1.0:1788845944.772277:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f010 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cca2 expref: 13 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845944.772318:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:1.0:1788845944.772327:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a77a96b-0efb-4559-b734-596c51917804+13:2354:x1875740720124032:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845944.772340:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845944.772345:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f010 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cca2 expref: 13 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845944.772358:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f010 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cca2 expref: 13 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845944.772377:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845944.772420:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a77a96b-0efb-4559-b734-596c51917804+13:2354:x1875740720124032:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 94us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845944.772438:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:0.0:1788845944.773788:0:8507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739026816 00000100:00100000:0.0:1788845944.773799:0:8507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739026816 00000100:00100000:0.0:1788845944.773909:0:8507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739026944 00000100:00100000:0.0:1788845944.773913:0:8507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739026944 00000100:00100000:0.0:1788845944.773991:0:8507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788845944.774000:0:8507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+4:11659:x1875740739026816:12345-0@lo:104: 00010000:00010000:0.0:1788845944.774014:0:8507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773f002 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845944.774197:0:8507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845944.774203:0:8507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+4:11659:x1875740739026816:12345-0@lo:104: Request processed in 205us (4816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845944.774210:0:8507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788845944.774317:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845944.774324:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773f002 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.774332:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf400 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:3.0:1788845944.774336:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773f002 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845944.774342:0:8507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788845944.774346:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773f002 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845944.774355:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773f002 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845944.774356:0:8507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26325500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:11659:x1875740739026944:12345-0@lo:104: 10000000:01000000:3.0:1788845944.774368:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788845944.774370:0:8507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773eff4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.774406:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773f002 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845944.774411:0:8507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788845944.774414:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845944.774422:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788845944.774429:0:8507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26325500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:11659:x1875740739026944:12345-0@lo:104: Request processed in 77us (4894us total) trans 0 rc 0/0 00010000:00010000:1.0:1788845944.774430:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773eff4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.774437:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773f002 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845944.774441:0:8507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788845944.774442:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf800 already unused, calling callback (ffffffffc1ba4c20) 00010000:00010000:3.0:1788845944.774448:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf400/0x1345bc80c773effb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773f002 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845944.774448:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773eff4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845944.774456:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773eff4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845944.774462:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773eff4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.774463:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845944.774466:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845944.774468:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788845944.774468:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788845944.774483:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845944.774496:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739027072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845944.774535:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845944.774560:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739027072 00000100:00100000:3.0:1788845944.774565:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739027072 00010000:00010000:3.0:1788845944.774594:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c01474c00/0x1345bc80c773f002 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773effb expref: 19 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845944.774621:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788845944.774628:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845944.774634:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739027072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845944.774645:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845944.774652:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c01474c00/0x1345bc80c773f002 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773effb expref: 19 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845944.774657:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720124160 00010000:00010000:3.0:1788845944.774662:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c01474c00/0x1345bc80c773f002 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773effb expref: 19 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845944.774662:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720124160 00010000:00010000:3.0:1788845944.774679:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845944.774681:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773f009 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc9b expref: 13 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845944.774706:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:0.0:1788845944.774716:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26397450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a77a96b-0efb-4559-b734-596c51917804+13:2353:x1875740720124160:12345-192.168.206.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788845944.774721:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739027072:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1788845944.774728:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788845944.774731:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1788845944.774737:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773f009 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc9b expref: 13 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845944.774750:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773f009 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc9b expref: 13 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845944.774764:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845944.774773:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739027072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845944.774799:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26397450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a77a96b-0efb-4559-b734-596c51917804+13:2353:x1875740720124160:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 85us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845944.774807:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00010000:00010000:2.0:1788845944.774910:0:11659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c02825000/0x1345bc80c773efe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773efdf expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.774923:0:11659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0c02825000/0x1345bc80c773efe6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773efdf expref: 18 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845944.774934:0:11659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26324380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875740739027200:0@lo:104: 00000100:00100000:2.0:1788845944.774959:0:11659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845944.774975:0:11659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412600 going to sleep for 11 seconds 00010000:00010000:2.0:1788845944.774988:0:11659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f010 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cca2 expref: 12 pid: 5840 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845944.775000:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875740739026560:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845944.775077:0:11659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c3ebce000/0x1345bc80c773f009 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc9b expref: 11 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845944.775088:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875740739026688:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845944.775100:0:11659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01474c00/0x1345bc80c773f002 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773effb expref: 18 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845944.775109:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875740739026816:0@lo:104: 00000100:00100000:2.0:1788845944.775117:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875740739026944:0@lo:104: 00010000:00010000:0.0:1788845944.775185:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773eff4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845944.775204:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788845944.775277:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788845944.775294:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739027200 00000100:00100000:3.0:1788845944.775298:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739027200 00000100:00100000:3.0:1788845944.775325:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788845944.775332:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0673e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:11659:x1875740739027200:12345-0@lo:104: 00010000:00010000:3.0:1788845944.775340:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773efe6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775378:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788845944.775384:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0673e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+3:11659:x1875740739027200:12345-0@lo:104: Request processed in 53us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845944.775390:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788845944.775430:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845944.775435:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773efe6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775441:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475a00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:3.0:1788845944.775445:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773efe6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775453:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773efe6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845944.775460:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773efe6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845944.775465:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788845944.775483:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773efe6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775489:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845944.775503:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773efe6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775510:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c773efdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773efe6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775521:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845944.775523:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845944.775525:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845944.775526:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773eff4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845944.775535:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773efed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773eff4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845944.775538:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739027456:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845944.775554:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845944.775557:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845944.775560:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845944.775572:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845944.775620:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739027328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788845944.775653:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845944.775666:0:11659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26324380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11659:1875740739027200:0@lo:104: 00010000:00010000:2.0:1788845944.775696:0:11659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845944.775720:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739027456 00000100:00100000:0.0:1788845944.775728:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739027328 00000100:00100000:0.0:1788845944.775735:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739027328 00000100:00100000:3.0:1788845944.775740:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739027456 00010000:00010000:0.0:1788845944.775753:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c3ebce800/0x1345bc80c773eff4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773efed expref: 19 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775760:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c02825000/0x1345bc80c773efe6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773efdf expref: 19 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845944.775782:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788845944.775795:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26322680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739027328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845944.775803:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845944.775807:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c3ebce800/0x1345bc80c773eff4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773efed expref: 19 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845944.775816:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c3ebce800/0x1345bc80c773eff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773efed expref: 19 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845944.775826:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c3ebce800/0x1345bc80c773eff4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773efed expref: 19 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845944.775834:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845944.775888:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788845944.775896:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:3309:x1875740739027456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845944.775904:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845944.775908:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c02825000/0x1345bc80c773efe6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773efdf expref: 18 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775917:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c02825000/0x1345bc80c773efe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773efdf expref: 18 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775928:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02825000/0x1345bc80c773efe6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773efdf expref: 18 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775938:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775946:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775957:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775965:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775971:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775978:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.775989:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824c00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788845944.775993:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.776001:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.776009:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845944.776017:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845944.776108:0:11659:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.776126:0:11659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845944.776132:0:11659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02824c00/0x1345bc80c773f13d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845944.776323:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:3309:x1875740739027456:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845944.776331:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788845944.776369:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739027456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788845944.776749:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739027328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845944.776809:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26322680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:3308:x1875740739027328:12345-0@lo:103:ldlm_bl.0 Request processed in 1020us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845944.776817:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1788845945.510459:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788845945.824308:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788845945.824328:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788845945.824561:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845945.824580:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739027584:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788845945.824640:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845945.824762:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739027584 00000100:00100000:0.0:1788845945.824781:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739027584 00000100:00100000:0.0:1788845945.824850:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788845945.824859:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739027584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788845945.824882:0:8094:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788845945.824912:0:8094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f9f74, atime: 0x6a9f9f74, ctime: 0x6a9f9f74, blocks: 0x1 00010000:00010000:0.0:1788845945.824920:0:8094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773f144 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845945.824934:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=278s v=(0 0) 00010000:00010000:0.0:1788845945.824939:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845945.824945:0:8094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773f144 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845945.824961:0:8094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773f144 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845945.824972:0:8094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773f144 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845945.824978:0:8094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773f144 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845945.824995:0:8094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788845945.825526:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1875740739027584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 666us (883us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788845945.825534:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788845945.825561:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845945.825573:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773f144 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845945.825581:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce800 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788845945.825585:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773f144 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845945.825594:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773f144 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845945.825610:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773f144 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845945.825617:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773f144 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845945.825635:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845945.825636:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845945.825638:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788845945.825938:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a0c3d7a9c00/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788845945.825944:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739027584:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1788845945.826003:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845945.953321:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845945.953581:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720124288 00000100:00100000:2.0:1788845945.953590:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720124288 00000100:00100000:2.0:1788845945.953691:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 242 00000100:00100000:2.0:1788845945.953701:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+11:5591:x1875740720124288:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845945.953716:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845945.953745:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f14b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ccef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845945.953773:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f14b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccef expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845945.953784:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f14b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccef expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845945.953793:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02825400, rc 0) 00000100:00100000:2.0:1788845945.953907:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+12:5591:x1875740720124288:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 208us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845945.953914:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 242 00000100:00100000:3.0:1788845945.961038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845945.961199:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720124416 00000100:00100000:0.0:1788845945.961208:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720124416 00000100:00100000:0.0:1788845945.961260:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 243 00000100:00100000:0.0:1788845945.961269:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+12:5591:x1875740720124416:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845945.961538:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+12:5591:x1875740720124416:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 268us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845945.961546:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 243 00000100:00100000:0.0:1788845945.976382:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845945.979075:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720124544 00000100:00100000:3.0:1788845945.979087:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720124544 00000100:00100000:3.0:1788845945.979148:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 244 00000100:00100000:3.0:1788845945.979192:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+12:5591:x1875740720124544:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845945.979421:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+12:5591:x1875740720124544:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 242us (3047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845945.979429:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 244 00000100:00100000:1.0:1788845945.986921:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845945.987177:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720124672 00000100:00100000:3.0:1788845945.987198:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720124672 00000100:00100000:3.0:1788845945.987298:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 245 00000100:00100000:3.0:1788845945.987309:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+12:9950:x1875740720124672:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788845945.987563:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+12:9950:x1875740720124672:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 255us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845945.987572:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 245 00000100:00100000:2.0:1788845945.995301:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845945.995496:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720124800 00000100:00100000:0.0:1788845945.995505:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720124800 00000100:00100000:0.0:1788845945.995559:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 246 00000100:00100000:0.0:1788845945.995569:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+12:9950:x1875740720124800:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788845945.995861:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18495050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+12:9950:x1875740720124800:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 292us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845945.995870:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 246 00000100:00100000:0.0:1788845945.999481:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845945.999811:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720124928 00000100:00100000:3.0:1788845945.999820:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720124928 00000100:00100000:3.0:1788845945.999875:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 247 00000100:00100000:3.0:1788845945.999886:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+12:5591:x1875740720124928:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845945.999901:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845945.999917:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c12f56200/0x1345bc80c773f152 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ccf6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845945.999944:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c12f56200/0x1345bc80c773f152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccf6 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845945.999955:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c12f56200/0x1345bc80c773f152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccf6 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845945.999964:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f56200, rc 0) 00000100:00100000:3.0:1788845946.000066:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18497c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:5591:x1875740720124928:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 182us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845946.000073:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 247 00000100:00100000:1.0:1788845946.015593:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845946.015682:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720125056 00000100:00100000:2.0:1788845946.015692:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720125056 00000100:00100000:2.0:1788845946.015754:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 248 00000100:00100000:2.0:1788845946.015764:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:5591:x1875740720125056:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845946.016019:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:5591:x1875740720125056:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 255us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845946.016027:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 248 00000100:00100000:2.0:1788845946.023931:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845946.024000:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720125184 00000100:00100000:0.0:1788845946.024009:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720125184 00000100:00100000:0.0:1788845946.024059:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 249 00000100:00100000:0.0:1788845946.024068:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:5591:x1875740720125184:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845946.024999:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:5591:x1875740720125184:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 257us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845946.025011:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 249 00000100:00100000:0.0:1788845946.028757:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845946.028839:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720125312 00000100:00100000:3.0:1788845946.028850:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720125312 00000100:00100000:3.0:1788845946.028913:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 250 00000100:00100000:3.0:1788845946.028922:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:9953:x1875740720125312:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788845946.029127:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:9953:x1875740720125312:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 205us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845946.029135:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 250 00000100:00100000:1.0:1788845946.038266:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845946.038471:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720125440 00000100:00100000:2.0:1788845946.038481:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720125440 00000100:00100000:2.0:1788845946.038527:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 251 00000100:00100000:2.0:1788845946.038536:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:9953:x1875740720125440:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788845946.039198:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:9953:x1875740720125440:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 659us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845946.039207:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 251 10000000:01000000:3.0:1788845946.150314:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788845946.150321:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c2067c000 from 7 10000000:01000000:3.0:1788845946.150325:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788845946.150380:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845946.150392:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845946.150403:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845946.150426:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739027712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788845946.150601:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845946.150720:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845946.151483:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739027712 00000100:00100000:0.0:1788845946.151491:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739027712 00000100:00100000:0.0:1788845946.152313:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788845946.152429:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:5842:x1875740739027712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845946.152446:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845946.152473:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c34a00800/0x1345bc80c773f160 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773f159 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845946.152626:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c34a00800/0x1345bc80c773f160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773f159 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845946.152640:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c34a00800/0x1345bc80c773f160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773f159 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845946.152650:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00800, rc 0) 00000100:00100000:1.0:1788845946.152801:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739027712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 466us (2303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845946.152809:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788845946.152882:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739027712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845946.152899:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845946.152909:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845946.152979:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739027840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845946.153019:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845946.153063:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845946.153070:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739027840 00000100:00100000:0.0:1788845946.153081:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739027840 00000100:00100000:0.0:1788845946.153171:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788845946.153196:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c18496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739027840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845946.153444:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c18496850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739027840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845946.153451:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788845946.153528:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739027840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845946.153558:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739027968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845946.153598:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845946.153627:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845946.154174:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739027968 00000100:00100000:1.0:1788845946.154192:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739027968 00000100:00100000:2.0:1788845946.154254:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788845946.154265:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739027968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845946.154417:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739027968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845946.154424:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788845946.154812:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739027968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845946.155686:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:11673:1875740739028096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845946.155737:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845946.155782:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788845946.155879:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739028096 00000100:00100000:0.0:1788845946.155885:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739028096 00000100:00100000:0.0:1788845946.155931:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788845946.155939:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c207cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:11673:x1875740739028096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845946.156131:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c207cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:11673:x1875740739028096:12345-0@lo:502:llog_process_th.0 Request processed in 191us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845946.156139:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788845946.156399:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:11673:1875740739028096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845946.156426:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845946.156435:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845946.156437:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788845946.156443:0:11673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a0c2067c000 00000020:00000080:3.0:1788845946.156446:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788845946.156605:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:11673:1875740739028224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845946.156637:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845946.156667:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788845946.157138:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739028224 00000100:00100000:0.0:1788845946.157144:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739028224 00000100:00100000:0.0:1788845946.157209:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788845946.157217:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:11673:x1875740739028224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845946.157368:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:11673:x1875740739028224:12345-0@lo:502:llog_process_th.0 Request processed in 151us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845946.157376:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788845946.157504:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:11673:1875740739028224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845946.157528:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845946.157533:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845946.157535:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788845946.157538:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788845946.157893:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788845946.157920:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845946.157931:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845946.157941:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845946.157951:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788845946.157954:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c3c96b800 from 7 10000000:01000000:0.0:1788845946.157957:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845946.157981:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845946.157990:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845946.158006:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845946.158021:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d7a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739028352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845946.158062:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845946.158091:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165180 going to sleep for 11 seconds 00000100:00100000:2.0:1788845946.158239:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739028352 00000100:00100000:2.0:1788845946.158246:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739028352 00000100:00100000:2.0:1788845946.158276:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788845946.158284:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:5842:x1875740739028352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845946.158302:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845946.158315:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773f16e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773f167 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845946.158335:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773f16e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773f167 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845946.158344:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773f16e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773f167 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845946.158353:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02824e00, rc 0) 00000100:00100000:2.0:1788845946.158392:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739028352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845946.158399:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788845946.159760:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d7a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739028352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845946.159780:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845946.159792:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845946.159849:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d7a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739028480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845946.159898:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845946.160067:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165180 going to sleep for 11 seconds 00000100:00100000:3.0:1788845946.160502:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739028480 00000100:00100000:3.0:1788845946.160516:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739028480 00000100:00100000:3.0:1788845946.160557:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788845946.160567:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739028480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845946.161698:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739028480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1130us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845946.161708:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788845946.161758:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d7a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739028480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845946.161806:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739028608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845946.161848:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845946.161882:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788845946.161895:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739028608 00000100:00100000:3.0:1788845946.161899:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739028608 00000100:00100000:3.0:1788845946.161926:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788845946.161933:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739028608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845946.162078:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739028608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845946.162084:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788845946.162121:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739028608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845946.162694:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:11675:1875740739028736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845946.162735:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845946.163024:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c364123c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845946.163108:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739028736 00000100:00100000:3.0:1788845946.163113:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739028736 00000100:00100000:3.0:1788845946.163373:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788845946.163382:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:11675:x1875740739028736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845946.163532:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:11675:x1875740739028736:12345-0@lo:502:llog_process_th.0 Request processed in 151us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845946.163539:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788845946.163651:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:11675:1875740739028736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845946.163675:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845946.163683:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845946.163686:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788845946.163691:0:11675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a0c3c96b800 00000020:00000080:2.0:1788845946.163694:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788845946.163757:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:11675:1875740739028864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845946.163801:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845946.163824:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739028864 00000100:00100000:2.0:1788845946.163828:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739028864 00000100:00100000:2.0:1788845946.163858:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788845946.163864:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:11675:x1875740739028864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845946.163972:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:11675:x1875740739028864:12345-0@lo:502:llog_process_th.0 Request processed in 107us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845946.163978:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788845946.164013:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c364123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845946.164025:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:11675:1875740739028864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845946.164125:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845946.164130:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845946.164131:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788845946.164135:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788845946.167266:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788845946.167303:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845946.167314:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845946.167326:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845946.167336:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788845946.167339:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c0942a000 from 7 10000000:01000000:2.0:1788845946.167341:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788845946.167377:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845946.167386:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845946.167397:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845946.167427:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739028992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845946.167486:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845946.167521:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c364123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845946.167539:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739028992 00000100:00100000:2.0:1788845946.167545:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739028992 00000100:00100000:2.0:1788845946.167580:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788845946.167588:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:5842:x1875740739028992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845946.167599:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845946.167609:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c02825e00/0x1345bc80c773f17c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773f175 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845946.167631:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c02825e00/0x1345bc80c773f17c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773f175 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845946.167641:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c02825e00/0x1345bc80c773f17c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773f175 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845946.167650:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02825e00, rc 0) 00000100:00100000:2.0:1788845946.167680:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739028992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845946.167686:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788845946.167722:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739028992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845946.167735:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845946.167744:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845946.167812:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739029120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845946.167836:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845946.167854:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c364123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845946.167865:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739029120 00000100:00100000:2.0:1788845946.167868:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739029120 00000100:00100000:2.0:1788845946.167885:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788845946.167890:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c0888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739029120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845946.168136:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c0888bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739029120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845946.168142:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788845946.168202:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739029120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845946.168236:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739029248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845946.168277:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845946.168302:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739029248 00000100:00100000:3.0:1788845946.168308:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739029248 00000100:00100000:2.0:1788845946.168312:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c364123c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845946.168352:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788845946.168359:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739029248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845946.168497:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:5842:x1875740739029248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845946.168504:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788845946.171240:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:355d8611-f7e8-4bd6-8079-f3ef5a03a561:5842:1875740739029248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845946.171641:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:11676:1875740739029376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845946.171781:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845946.171821:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c36412e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845946.171829:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739029376 00000100:00100000:3.0:1788845946.171837:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739029376 00000100:00100000:3.0:1788845946.171880:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788845946.171890:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:11676:x1875740739029376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845946.172095:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:11676:x1875740739029376:12345-0@lo:502:llog_process_th.0 Request processed in 205us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845946.172103:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788845946.172525:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:11676:1875740739029376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845946.172553:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845946.172562:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845946.172565:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788845946.172571:0:11676:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a0c0942a000 00000020:00000080:2.0:1788845946.172580:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788845946.172662:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:11676:1875740739029504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845946.172710:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845946.172744:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739029504 00000100:00100000:2.0:1788845946.172749:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739029504 00000100:00100000:2.0:1788845946.172773:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788845946.172780:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:11676:x1875740739029504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845946.172911:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:11676:x1875740739029504:12345-0@lo:502:llog_process_th.0 Request processed in 130us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845946.172917:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788845946.172950:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074f2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845946.172963:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:355d8611-f7e8-4bd6-8079-f3ef5a03a561:11676:1875740739029504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845946.172983:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845946.172987:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845946.172988:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788845946.172992:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788845946.173405:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788845946.173426:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845946.173434:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845946.173443:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788845946.186115:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788845946.279476:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739029632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845946.279544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845946.279687:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739029632 00000100:00100000:0.0:1788845946.279695:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739029632 00000100:00100000:0.0:1788845946.279741:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788845946.279751:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739029632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845946.279782:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845946.279832:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739029632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845946.279839:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788845946.280000:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739029632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788845946.534567:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788845947.239220:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788845947.558432:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845948.326360:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845948.326383:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739030016:0@lo:400:kworker.0 00000100:00100000:0.0:1788845948.326399:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739030400:0@lo:400:kworker.0 00000100:00100000:3.0:1788845948.326406:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739030144:0@lo:400:kworker.0 00000100:00100000:1.0:1788845948.326446:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739029888:0@lo:400:kworker.0 00000100:00100000:2.0:1788845948.326457:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845948.326496:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845948.326498:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739030016 00000100:00100000:3.0:1788845948.326505:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739030016 00000100:00100000:1.0:1788845948.326509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845948.326526:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739029760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845948.326541:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845948.326551:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3da24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739030272:0@lo:400:kworker.0 00000100:00100000:0.0:1788845948.326552:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739030528:0@lo:400:kworker.0 00000100:00100000:3.0:1788845948.326553:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739030400 00000100:00100000:3.0:1788845948.326557:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739030400 00000100:00100000:2.0:1788845948.326580:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845948.326595:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788845948.326605:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845948.326606:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739030016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845948.326616:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739029888 00000100:00100000:1.0:1788845948.326622:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739029888 00000100:00100000:2.0:1788845948.326625:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739029760 00000100:00100000:2.0:1788845948.326631:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739029760 00000100:00100000:0.0:1788845948.326660:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788845948.326666:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788845948.326672:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739030400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845948.326677:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788845948.326679:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739029888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845948.326680:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739030016:12345-0@lo:400:kworker.0 Request processed in 64us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845948.326692:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788845948.326701:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739029760:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788845948.326720:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845948.326726:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845948.326731:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739029888:12345-0@lo:400:kworker.0 Request processed in 56us (224us total) trans 0 rc 0/0 00002000:00000024:2.0:1788845948.326738:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845948.326738:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739030400:12345-0@lo:400:kworker.0 Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845948.326743:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788845948.326753:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788845948.326756:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739030016:0@lo:400:kworker.0 00000100:00100000:0.0:1788845948.326790:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739030528 00000100:00100000:0.0:1788845948.326794:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739030528 00000100:00100000:2.0:1788845948.326799:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875740739029760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (218us total) trans 0 rc 0/0 00010000:00080000:3.0:1788845948.326806:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c26326d80 x1875740739029760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845948.326811:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788845948.326812:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845948.326830:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739029760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845948.326839:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739030272 00000100:00100000:0.0:1788845948.326842:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739030272 00000100:00100000:1.0:1788845948.326854:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739029888:0@lo:400:kworker.0 00000100:00100000:3.0:1788845948.326869:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788845948.326878:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739030528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845948.326878:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788845948.326885:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788845948.326885:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875740739030272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845948.326899:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788845948.326914:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739030528:12345-0@lo:400:kworker.0 Request processed in 37us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845948.326917:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875740739030272:12345-0@lo:400:kworker.0 Request processed in 34us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845948.326924:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788845948.326927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845948.326931:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788845948.326947:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845948.326967:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739030144 00000100:00100000:3.0:1788845948.326971:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739030144 00010000:00080000:1.0:1788845948.326996:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c352aea00 x1875740739030528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845948.327005:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788845948.327007:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845948.327012:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739030528:0@lo:400:kworker.0 00000100:00100000:3.0:1788845948.327016:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739030144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845948.327033:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739030400:0@lo:400:kworker.0 00000100:00100000:0.0:1788845948.327040:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3da24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739030272:0@lo:400:kworker.0 00000100:00100000:3.0:1788845948.327076:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739030144:12345-0@lo:400:kworker.0 Request processed in 62us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845948.327088:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788845948.327387:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739030144:0@lo:400:kworker.0 00010000:00010000:0.0:1788845948.582427:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845948.829691:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845948.829722:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845948.829944:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845948.829976:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845948.829999:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720125568 00000100:00100000:1.0:1788845948.830009:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720125568 00000100:00100000:2.0:1788845948.830022:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720125824 00000100:00100000:2.0:1788845948.830028:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720125824 00000100:00100000:1.0:1788845948.830061:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 268 00000100:00100000:1.0:1788845948.830073:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720125568:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845948.830084:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:2.0:1788845948.830093:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720125824:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845948.830139:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720125568:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845948.830146:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 268 00000100:00100000:3.0:1788845948.830229:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720125696 00000100:00100000:3.0:1788845948.830234:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720125696 00000100:00100000:3.0:1788845948.830262:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720125952 00000100:00100000:3.0:1788845948.830265:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720125952 00000100:00100000:3.0:1788845948.830285:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:2.0:1788845948.830720:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720125824:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 626us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845948.830728:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00080000:2.0:1788845948.830749:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845948.830754:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845948.830884:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720125696:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845948.830938:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720125696:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 647us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845948.830943:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:3.0:1788845948.830952:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:2.0:1788845948.830957:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720125952:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845948.830990:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720125952:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 38us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845948.830997:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 86 00010000:00010000:0.0:1788845949.606421:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845950.633189:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788845950.938552:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:0.0:1788845951.401983:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845951.402007:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739030656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845951.402069:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845951.402299:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739030656 00000100:00100000:1.0:1788845951.402306:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739030656 00000100:00100000:1.0:1788845951.402371:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788845951.402381:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739030656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845951.402415:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845951.402459:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739030656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845951.402466:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788845951.402554:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788845951.402561:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a0c3d7a9c00, transno 4294967300 00000100:00100000:0.0:1788845951.402601:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739030656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788845951.403395:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788845951.654295:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845952.678448:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845953.446381:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740739031040:0@lo:400:kworker.0 00000100:00100000:3.0:1788845953.446440:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845953.446494:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788845953.446500:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739030912:0@lo:400:kworker.0 00000100:00100000:3.0:1788845953.446519:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845953.446534:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739031424:0@lo:400:kworker.0 00000100:00100000:1.0:1788845953.446555:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739031168:0@lo:400:kworker.0 00000100:00100000:3.0:1788845953.446556:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845953.446585:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739031552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845953.446598:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739031040 00000100:00100000:1.0:1788845953.446601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845953.446615:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845953.446620:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739031040 00000100:00100000:1.0:1788845953.446653:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788845953.446662:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739030784:0@lo:400:kworker.0 00000100:00100000:3.0:1788845953.446666:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739030912 00000100:00100000:3.0:1788845953.446671:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739030912 00000100:00100000:1.0:1788845953.446695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845953.446731:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739031424 00000100:00100000:1.0:1788845953.446734:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739031296:0@lo:400:kworker.0 00000100:00100000:0.0:1788845953.446738:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739031424 00000100:00100000:1.0:1788845953.446762:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845953.450759:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739031168 00000100:00100000:0.0:1788845953.450773:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739031168 00000100:00100000:3.0:1788845953.452564:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739031296 00000100:00100000:3.0:1788845953.452575:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739031296 00000100:00100000:3.0:1788845953.452624:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788845953.452634:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740739031040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845953.452729:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740739031040:12345-0@lo:400:kworker.0 Request processed in 96us (6288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845953.452736:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788845953.452754:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788845953.452760:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739030912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845953.452789:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739030912:12345-0@lo:400:kworker.0 Request processed in 29us (6269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845953.452795:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788845953.452807:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788845953.452814:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739031296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845953.452849:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739031296:12345-0@lo:400:kworker.0 Request processed in 36us (6088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845953.452856:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788845953.452905:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739030912:0@lo:400:kworker.0 00000100:00100000:3.0:1788845953.452918:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740739031040:0@lo:400:kworker.0 00000100:00100000:3.0:1788845953.452963:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739031552 00000100:00100000:3.0:1788845953.452967:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739031552 00000100:00100000:3.0:1788845953.452994:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788845953.453001:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875740739031552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845953.453024:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788845953.453059:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875740739031552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (6446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845953.453065:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788845953.453093:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c206d0000 x1875740739031552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845953.453120:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739031552:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788845953.453172:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845953.453176:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845953.453178:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845953.453726:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788845953.453738:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739031424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845953.453786:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739031424:12345-0@lo:400:kworker.0 Request processed in 52us (7230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845953.453792:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788845953.453808:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788845953.453815:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739031168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845953.453841:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739031168:12345-0@lo:400:kworker.0 Request processed in 27us (7243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845953.453846:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788845953.453865:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739030784 00000100:00100000:1.0:1788845953.453870:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739030784 00000100:00100000:1.0:1788845953.453897:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788845953.453905:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739030784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845953.453935:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739030784:12345-0@lo:400:kworker.0 Request processed in 32us (7241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845953.453941:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788845953.453989:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739030784:0@lo:400:kworker.0 00000100:00100000:1.0:1788845953.454004:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739031296:0@lo:400:kworker.0 00000100:00100000:1.0:1788845953.454014:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739031168:0@lo:400:kworker.0 00010000:00080000:1.0:1788845953.454048:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c088de680 x1875740739031424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845953.454073:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739031424:0@lo:400:kworker.0 00010000:00010000:3.0:1788845953.702368:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845953.950826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845953.950867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845953.950912:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845953.951004:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720126208 00000100:00100000:1.0:1788845953.951013:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720126208 00000100:00100000:1.0:1788845953.951064:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720126464 00000100:00100000:1.0:1788845953.951067:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720126464 00000100:00100000:1.0:1788845953.951092:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:1.0:1788845953.951101:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720126208:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845953.951223:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720126208:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 123us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845953.951231:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:1.0:1788845953.951248:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:1.0:1788845953.951255:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720126464:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845953.951284:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720126464:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 30us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845953.951290:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:2.0:1788845953.953217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00080000:3.0:1788845953.953395:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845953.956075:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720126336 00000100:00100000:1.0:1788845953.956088:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720126336 00000100:00100000:1.0:1788845953.956207:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:1.0:1788845953.956218:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720126336:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845953.956299:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720126336:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 83us (3097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845953.956306:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00080000:3.0:1788845953.956550:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845953.956947:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720126080 00000100:00100000:0.0:1788845953.956954:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720126080 00000100:00100000:0.0:1788845953.956994:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 270 00000100:00100000:0.0:1788845953.957002:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720126080:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788845953.957049:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720126080:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 48us (6140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845953.957056:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 270 00010000:00010000:0.0:1788845954.726441:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845955.750295:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845956.519468:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845956.519489:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739031680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845956.519552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845956.519706:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739031680 00000100:00100000:1.0:1788845956.519714:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739031680 00000100:00100000:1.0:1788845956.519785:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788845956.519795:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739031680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845956.519827:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845956.519872:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739031680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845956.519880:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788845956.519923:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739031680:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788845956.521340:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788845956.774532:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788845957.478815:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788845957.798327:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845958.566688:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739032064:0@lo:400:kworker.0 00000100:00100000:2.0:1788845958.566717:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739031936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845958.566815:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739032192:0@lo:400:kworker.0 00000100:00100000:2.0:1788845958.570224:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845958.570276:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739031936 00000100:00100000:0.0:1788845958.570285:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739031936 00000100:00100000:2.0:1788845958.570289:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c088de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739032448:0@lo:400:kworker.0 00000100:00100000:2.0:1788845958.570323:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845958.570347:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788845958.570355:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739031936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845958.570400:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845958.570411:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739031808:0@lo:400:kworker.0 00000100:00100000:0.0:1788845958.570446:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739031936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845958.570465:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788845958.570502:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845958.570509:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739032448 00000100:00100000:0.0:1788845958.570513:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739032448 00000100:00100000:2.0:1788845958.570527:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739032320:0@lo:400:kworker.0 00000100:00100000:0.0:1788845958.570539:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788845958.570545:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739032448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845958.570551:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845958.570574:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739032448:12345-0@lo:400:kworker.0 Request processed in 29us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845958.570580:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739031808 00000100:00100000:0.0:1788845958.570580:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788845958.570583:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739031808 00000100:00100000:2.0:1788845958.570607:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788845958.570613:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739031808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845958.570619:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739032320 00000100:00100000:0.0:1788845958.570622:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739032320 00000100:00100000:2.0:1788845958.570645:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739031808:12345-0@lo:400:kworker.0 Request processed in 33us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845958.570650:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788845958.570690:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739031808:0@lo:400:kworker.0 00010000:00080000:2.0:1788845958.570721:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c206d1f80 x1875740739031936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845958.570736:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739031936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845958.570747:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c088de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739032448:0@lo:400:kworker.0 00000100:00080000:2.0:1788845958.570780:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845958.570783:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788845958.570784:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845958.570786:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845958.570791:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739032320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845958.570828:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739032320:12345-0@lo:400:kworker.0 Request processed in 38us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845958.570834:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788845958.570857:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739032320:0@lo:400:kworker.0 00000100:00100000:1.0:1788845958.571914:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845958.573789:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845958.574060:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739032576:0@lo:400:kworker.0 00000100:00100000:1.0:1788845958.574102:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845958.577996:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739032576 00000100:00100000:1.0:1788845958.578009:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739032576 00000100:00100000:1.0:1788845958.578078:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788845958.578089:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739032576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845958.578199:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739032576:12345-0@lo:400:kworker.0 Request processed in 113us (4096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845958.578207:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788845958.578361:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c1841e300 x1875740739032576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845958.578376:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739032576:0@lo:400:kworker.0 00000100:00100000:0.0:1788845958.580100:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739032064 00000100:00100000:0.0:1788845958.580111:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739032064 00000100:00100000:0.0:1788845958.580185:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739032192 00000100:00100000:0.0:1788845958.580189:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739032192 00000100:00100000:0.0:1788845958.580275:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788845958.580284:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739032064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845958.580348:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739032064:12345-0@lo:400:kworker.0 Request processed in 65us (8437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845958.580355:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788845958.580384:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788845958.580391:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739032192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845958.580443:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739032192:12345-0@lo:400:kworker.0 Request processed in 53us (6659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845958.580450:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788845958.580993:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845958.581030:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739032192:0@lo:400:kworker.0 00000100:00100000:1.0:1788845958.581508:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739032064:0@lo:400:kworker.0 00010000:00010000:0.0:1788845958.822301:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845959.070383:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845959.070463:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845959.070560:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720126592 00000100:00100000:1.0:1788845959.070571:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720126592 00000100:00100000:1.0:1788845959.070636:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 272 00000100:00100000:1.0:1788845959.070658:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2351:x1875740720126592:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845959.070743:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2351:x1875740720126592:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 87us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845959.070751:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 272 00000100:00100000:0.0:1788845959.071149:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720126720 00000100:00100000:0.0:1788845959.071182:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720126720 00000100:00100000:0.0:1788845959.071236:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 95 00000100:00100000:0.0:1788845959.071245:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2351:x1875740720126720:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788845959.071289:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2351:x1875740720126720:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 46us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845959.071296:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 95 00000100:00100000:2.0:1788845959.071419:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00080000:3.0:1788845959.071429:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845959.071455:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845959.071524:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720126976 00000100:00100000:0.0:1788845959.071529:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720126976 00000100:00100000:0.0:1788845959.071581:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 96 00000100:00100000:0.0:1788845959.071594:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720126976:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788845959.071629:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720126976:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 41us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845959.071636:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 96 00000100:00080000:3.0:1788845959.071674:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845959.072277:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720126848 00000100:00100000:1.0:1788845959.072282:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720126848 00000100:00100000:1.0:1788845959.072315:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:1.0:1788845959.072320:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720126848:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845959.072357:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720126848:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 37us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845959.072361:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00080000:3.0:1788845959.073106:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788845959.846343:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845960.871010:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845961.638379:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845961.638400:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739032704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845961.638465:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845961.639595:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739032704 00000100:00100000:0.0:1788845961.639605:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739032704 00000100:00100000:0.0:1788845961.639680:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788845961.639689:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739032704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845961.639719:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845961.639783:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739032704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845961.639805:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788845961.641148:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739032704:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788845961.641253:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788845961.894481:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845962.918489:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845963.686501:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845963.686525:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739032832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845963.686606:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845963.686662:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739032832 00000100:00100000:3.0:1788845963.686671:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739032832 00000100:00100000:2.0:1788845963.686676:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739033344:0@lo:400:kworker.0 00000100:00100000:2.0:1788845963.686714:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845963.686728:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788845963.686740:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739032832:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845963.686767:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00000024:3.0:1788845963.686774:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845963.686776:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875740739033216:0@lo:400:kworker.0 00000100:00100000:2.0:1788845963.686805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845963.686834:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739032832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845963.686842:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739033344 00000100:00100000:3.0:1788845963.686846:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788845963.686847:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739033344 00000100:00080000:3.0:1788845963.686875:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845963.686880:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845963.686887:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788845963.686896:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739033344:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788845963.686905:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c26320700 x1875740739032832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845963.686925:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739032832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845963.686939:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739033344:12345-0@lo:400:kworker.0 Request processed in 43us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845963.686947:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788845963.686975:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739033216 00000100:00100000:3.0:1788845963.686980:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739033216 00000100:00100000:2.0:1788845963.686984:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739033344:0@lo:400:kworker.0 00000100:00100000:3.0:1788845963.687014:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1788845963.687015:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845963.687024:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875740739033216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845963.687068:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875740739033216:12345-0@lo:400:kworker.0 Request processed in 46us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845963.687075:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788845963.687084:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739032960:0@lo:400:kworker.0 00000100:00100000:0.0:1788845963.687172:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845963.687201:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739033472:0@lo:400:kworker.0 00000100:00100000:0.0:1788845963.687223:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845963.687241:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845963.687247:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739033088:0@lo:400:kworker.0 00000100:00100000:3.0:1788845963.687261:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739032960 00000100:00100000:3.0:1788845963.687266:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739032960 00000100:00100000:0.0:1788845963.687270:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845963.687296:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788845963.687302:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739033472 00000100:00100000:3.0:1788845963.687307:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739032960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845963.687308:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739033472 00000100:00100000:0.0:1788845963.687343:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739033088 00000100:00100000:0.0:1788845963.687347:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739033088 00000100:00100000:3.0:1788845963.687356:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739032960:12345-0@lo:400:kworker.0 Request processed in 51us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845963.687363:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788845963.687372:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788845963.687380:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739033472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845963.687396:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788845963.687406:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739033088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845963.687417:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739033472:12345-0@lo:400:kworker.0 Request processed in 37us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845963.687426:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788845963.687444:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739033088:12345-0@lo:400:kworker.0 Request processed in 40us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845963.687461:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788845963.687473:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739033088:0@lo:400:kworker.0 00000100:00100000:0.0:1788845963.687486:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739032960:0@lo:400:kworker.0 00000100:00100000:0.0:1788845963.687497:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739033472:0@lo:400:kworker.0 00000100:00100000:2.0:1788845963.687756:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875740739033216:0@lo:400:kworker.0 00000100:00080000:2.0:1788845963.687771:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788845963.942326:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845964.192475:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845964.192522:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845964.192533:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720127232 00000100:00100000:0.0:1788845964.192542:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720127232 00000100:00100000:0.0:1788845964.192611:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 100 00000100:00100000:0.0:1788845964.192634:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720127232:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788845964.192702:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720127232:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 70us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845964.192710:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 100 00000100:00100000:1.0:1788845964.192787:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720127104 00000100:00100000:1.0:1788845964.192792:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720127104 00000100:00100000:1.0:1788845964.192836:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 274 00000100:00100000:1.0:1788845964.192843:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720127104:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845964.192878:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720127104:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 36us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845964.192884:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 274 00000100:00080000:3.0:1788845964.193557:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845964.206699:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845964.208063:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720127488 00000100:00100000:3.0:1788845964.208076:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720127488 00000100:00100000:3.0:1788845964.208269:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 101 00000100:00100000:3.0:1788845964.208279:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2351:x1875740720127488:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845964.208360:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2351:x1875740720127488:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 82us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845964.208593:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 101 00000100:00080000:2.0:1788845964.209453:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845964.214939:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845964.215318:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720127360 00000100:00100000:1.0:1788845964.215328:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720127360 00000100:00080000:2.0:1788845964.215418:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845964.215473:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:1.0:1788845964.215484:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2350:x1875740720127360:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:1.0:1788845964.215582:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773f0b8 00000100:00080000:1.0:1788845964.215593:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9a0c34df2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788845964.215631:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1788845964.215693:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845964.215925:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+2:2350:x1875740720127360:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 442us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845964.215934:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00010000:00010000:3.0:1788845964.969361:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845965.991673:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788845966.307704:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4592a189-21d8-449a-9335-07bfe0dc7877 00000020:00000080:2.0:1788845966.307713:0:6720:0:(genops.c:885:class_export_put()) final put ffff9a0c2067c800/4592a189-21d8-449a-9335-07bfe0dc7877 00000020:00000080:0.0:1788845966.307837:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c2067c800/4592a189-21d8-449a-9335-07bfe0dc7877 for lustre-OST0000 00000020:00000080:0.0:1788845966.307887:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c34df2800 for lustre-OST0000 00000100:00100000:2.0:1788845966.758611:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c1841ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739033600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845966.758683:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845966.758778:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739033600 00000100:00100000:0.0:1788845966.758786:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739033600 00000100:00100000:0.0:1788845966.758839:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788845966.758848:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739033600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845966.758876:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788845966.758932:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845966.760354:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739033600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1502us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845966.760364:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788845966.760468:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c1841ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739033600:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788845967.015378:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788845967.718979:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788845968.045626:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788845968.542803:0:11842:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:39:26 (1788845966) 00000100:00100000:2.0:1788845968.807698:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740739033984:0@lo:400:kworker.0 00000100:00100000:0.0:1788845968.807730:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739034240:0@lo:400:kworker.0 00000100:00100000:2.0:1788845968.807761:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845968.807761:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845968.807806:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739033728:0@lo:400:kworker.0 00000100:00100000:2.0:1788845968.807812:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739034496:0@lo:400:kworker.0 00000100:00100000:1.0:1788845968.807890:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739034112:0@lo:400:kworker.0 00000100:00100000:2.0:1788845968.812101:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739034240 00000100:00100000:2.0:1788845968.812133:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739034240 00000100:00100000:2.0:1788845968.812220:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788845968.812231:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739034240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845968.812313:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739034240:12345-0@lo:400:kworker.0 Request processed in 84us (4552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845968.812321:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788845968.812345:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739033984 00000100:00100000:2.0:1788845968.812349:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739033984 00000100:00100000:2.0:1788845968.812449:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788845968.812457:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740739033984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845968.812470:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845968.812503:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740739033984:12345-0@lo:400:kworker.0 Request processed in 48us (4743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845968.812527:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788845968.812557:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845968.814798:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845968.815298:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739033856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845968.815336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845968.815355:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739034368:0@lo:400:kworker.0 00000100:00100000:3.0:1788845968.815379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845968.815455:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739033728 00000100:00100000:3.0:1788845968.815462:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739033728 00000100:00100000:3.0:1788845968.815525:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788845968.815534:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739033728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845968.815583:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739033728:12345-0@lo:400:kworker.0 Request processed in 50us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845968.815601:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788845968.815634:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739034112 00000100:00100000:3.0:1788845968.815638:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739034112 00000100:00100000:3.0:1788845968.815667:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739034368 00000100:00100000:3.0:1788845968.815670:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739034368 00000100:00100000:3.0:1788845968.815690:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788845968.815697:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739034112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845968.815733:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739034112:12345-0@lo:400:kworker.0 Request processed in 36us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845968.815739:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788845968.815750:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788845968.815756:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739034368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845968.815782:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739034368:12345-0@lo:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845968.815787:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1788845968.815808:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845968.815870:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739033728:0@lo:400:kworker.0 00000100:00100000:3.0:1788845968.815884:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d7aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739034368:0@lo:400:kworker.0 00000100:00100000:3.0:1788845968.818325:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845968.818387:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740739033984:0@lo:400:kworker.0 00000100:00100000:3.0:1788845968.818428:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739034496 00000100:00100000:3.0:1788845968.818433:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739034496 00000100:00100000:3.0:1788845968.819443:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788845968.819462:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739034496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845968.819620:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739034496:12345-0@lo:400:kworker.0 Request processed in 163us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845968.819637:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788845968.819664:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788845968.819688:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d7a9c00 x1875740739034496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845968.819700:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739034496:0@lo:400:kworker.0 00000100:00100000:0.0:1788845968.819836:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739034240:0@lo:400:kworker.0 00000100:00100000:1.0:1788845968.820351:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739033856 00000100:00100000:1.0:1788845968.820359:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739033856 00000100:00100000:1.0:1788845968.820403:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788845968.820411:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739033856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845968.820436:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845968.820493:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739033856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (5156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845968.820499:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788845968.820534:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739034112:0@lo:400:kworker.0 00010000:00080000:3.0:1788845968.820638:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d664a80 x1875740739033856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845968.820654:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739033856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788845969.063458:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845969.312650:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845969.312691:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845969.312724:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720127616 00000100:00100000:2.0:1788845969.312731:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845969.312736:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720127616 00000100:00100000:2.0:1788845969.312773:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720127872 00000100:00100000:2.0:1788845969.312778:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720127872 00000100:00100000:3.0:1788845969.312791:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 276 00000100:00100000:3.0:1788845969.312804:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:2353:x1875740720127616:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845969.312822:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720127744 00000100:00100000:2.0:1788845969.312827:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720127744 00000100:00100000:2.0:1788845969.312856:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 105 00000100:00100000:2.0:1788845969.312864:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8450d7e-d658-40b4-8296-b4731edf9929+5:2353:x1875740720127872:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845969.312873:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:2353:x1875740720127616:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 71us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845969.312881:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 276 00000100:00100000:2.0:1788845969.312903:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8450d7e-d658-40b4-8296-b4731edf9929+5:2353:x1875740720127872:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 38us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845969.312911:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 105 00000100:00100000:2.0:1788845969.312927:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 106 00000100:00100000:2.0:1788845969.312933:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+5:2353:x1875740720127744:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845969.312963:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+5:2353:x1875740720127744:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 31us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845969.312970:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 106 00000100:00080000:2.0:1788845969.312998:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788845970.086275:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845970.266803:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845970.266956:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720128000 00000100:00100000:2.0:1788845970.266966:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720128000 00000100:00100000:2.0:1788845970.267026:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:2.0:1788845970.267037:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+5:10221:x1875740720128000:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845970.267067:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845970.267104:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f183 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ccfd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.267206:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f18a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.267220:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f18a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.267232:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f18a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845970.267265:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788845970.267268:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845970.267306:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f18a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.267327:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccfd expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.267343:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f18a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccfd expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.267350:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:2.0:1788845970.267353:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845970.267356:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02824c00, rc 0) 00000100:00100000:2.0:1788845970.267413:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:10221:x1875740720128000:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 378us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845970.267420:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:3.0:1788845970.275552:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845970.275643:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720128128 00000100:00100000:2.0:1788845970.275665:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720128128 00000100:00100000:2.0:1788845970.275729:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:2.0:1788845970.275739:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:10222:x1875740720128128:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845970.275757:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845970.275776:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f191 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd04 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.275831:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f198 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.275844:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f198 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.275856:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f198 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.275871:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f19f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.275878:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f19f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.275884:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f19f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276071:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030400/0x1345bc80c773f1a6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276080:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030400/0x1345bc80c773f1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276087:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030400/0x1345bc80c773f1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845970.276131:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788845970.276134:0:7134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845970.276149:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030400/0x1345bc80c773f1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276184:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f198 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276189:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f198 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276196:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f198 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276201:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845970.276205:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f198 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276212:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f198 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276224:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:2.0:1788845970.276227:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845970.276231:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f198 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276236:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f198 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276248:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f19f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276263:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f19f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276269:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f19f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276274:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845970.276278:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f19f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276284:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f19f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276291:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a0c04c4f800) 00010000:00010000:2.0:1788845970.276294:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845970.276296:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f19f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276301:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f19f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276328:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f191 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd04 expref: 8 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276340:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030400/0x1345bc80c773f1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd04 expref: 7 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.276348:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a0c04c4fd00) 00010000:00010000:2.0:1788845970.276350:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845970.276357:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030400, rc 0) 00000100:00100000:2.0:1788845970.276411:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+7:10222:x1875740720128128:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 673us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845970.276418:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:3.0:1788845970.279515:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845970.279589:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720128384 00000100:00100000:2.0:1788845970.279604:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720128384 00000100:00100000:2.0:1788845970.279654:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:2.0:1788845970.279664:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:10222:x1875740720128384:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845970.279682:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845970.279709:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f1ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd0b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.279777:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f1b4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.279791:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f1b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.279801:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f1b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.279856:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f1bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.279864:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f1bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.279871:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f1bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280219:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031200/0x1345bc80c773f1c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280234:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031200/0x1345bc80c773f1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280242:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031200/0x1345bc80c773f1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845970.280252:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788845970.280387:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f1b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280395:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f1b4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280402:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f1b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280408:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845970.280412:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f1b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280419:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f1b4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280431:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a0c04c4fd00) 00010000:00010000:2.0:1788845970.280433:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845970.280437:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f1b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280442:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f1b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280453:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f1bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280464:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f1bb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280469:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f1bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280473:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845970.280476:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f1bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280482:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f1bb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280490:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a0c04c4f400) 00010000:00010000:2.0:1788845970.280492:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845970.280495:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f1bb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280501:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f1bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280906:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f1ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd0b expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280921:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031200/0x1345bc80c773f1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd0b expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845970.280928:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f200) 00010000:00010000:2.0:1788845970.280931:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845970.280939:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00031200, rc 0) 00000100:00100000:2.0:1788845970.281000:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+9:10222:x1875740720128384:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 1337us (1494us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788845970.281008:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:0.0:1788845970.283560:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845970.285379:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720128512 00000100:00100000:2.0:1788845970.285391:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720128512 00000100:00100000:2.0:1788845970.285455:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:2.0:1788845970.285465:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+9:10222:x1875740720128512:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788845970.285577:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+9:10222:x1875740720128512:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 113us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845970.285585:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00000040:00080000:2.0:1788845970.791820:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788845971.110292:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788845971.412908:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:0.0:1788845971.880378:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739034624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845971.880440:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845971.880907:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739034624 00000100:00100000:2.0:1788845971.880915:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739034624 00000100:00100000:2.0:1788845971.880982:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788845971.880992:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739034624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845971.881024:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845971.881084:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739034624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845971.881092:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788845971.881138:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739034624:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788845971.881233:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845971.887824:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845971.887898:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720128640 00000100:00100000:2.0:1788845971.887907:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720128640 00000100:00100000:2.0:1788845971.887968:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:2.0:1788845971.887977:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:10264:x1875740720128640:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845971.887995:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845971.888019:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f1d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd12 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888083:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f1d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888096:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f1d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888108:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f1d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888121:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f1de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888127:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f1de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888133:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f1de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788845971.888393:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788845971.888479:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f1d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888488:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f1d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888494:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f1d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888499:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845971.888503:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f1d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888519:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f1d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888531:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:2.0:1788845971.888534:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845971.888539:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f1d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888545:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f1d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888556:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f1de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888561:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f1de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888567:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f1de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888572:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845971.888574:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f1de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888580:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f1de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888586:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a0c04c4ff00) 00010000:00010000:2.0:1788845971.888588:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845971.888591:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f1de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888606:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f1de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888637:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f1d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd12 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888648:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:2.0:1788845971.888649:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845971.888652:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f1d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd12 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.888662:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00031000, rc 0) 00000100:00100000:2.0:1788845971.888720:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:10264:x1875740720128640:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 744us (902us total) trans 0 rc 301/301 00000100:00100000:2.0:1788845971.888727:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:0.0:1788845971.894805:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845971.894885:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720128896 00000100:00100000:3.0:1788845971.894894:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720128896 00000100:00100000:3.0:1788845971.894993:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:3.0:1788845971.895004:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+8:10264:x1875740720128896:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:3.0:1788845971.895066:0:7134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845971.895099:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f18a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccfd expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.895132:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:3.0:1788845971.895142:0:7134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845971.895376:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f1e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.895390:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f1e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.895401:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f1e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.895412:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f1ec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.895419:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f1ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.895425:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f1ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845971.897255:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788845971.897271:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f1e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.897279:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f1e5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.897286:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f1e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.897298:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845971.897309:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f1e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.897316:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f1e5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.897329:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:3.0:1788845971.897332:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845971.897335:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f1e5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.897341:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f1e5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845971.897358:0:7134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b73f117a reply state 000000006054623b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f1ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845971.897366:0:7134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788845971.897470:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+9:10264:x1875740720128896:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 2464us (2669us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788845971.897478:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00010000:00010000:3.0:1788845971.909902:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f1ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.909918:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f1ec lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.909926:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f1ec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.909931:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845971.909935:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f1ec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.909950:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f1ec lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.909966:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a0c31164b00) 00010000:00010000:3.0:1788845971.909969:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845971.909973:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f1ec lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.909978:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f1ec lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845971.993033:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845971.993131:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720129024 00000100:00100000:1.0:1788845971.993141:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720129024 00000100:00100000:1.0:1788845971.993237:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:1.0:1788845971.993247:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+8:10272:x1875740720129024:12345-192.168.206.48@tcp:101:lctl.0 00010000:00010000:1.0:1788845971.993268:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845971.993288:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f1f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd19 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845971.993362:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f1fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845971.993374:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f1fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845971.993384:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f1fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845971.993414:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788845971.993418:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845971.993451:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f1fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845971.993473:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f1f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd19 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845971.993489:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f1fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd19 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845971.993499:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:1.0:1788845971.993502:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845971.993505:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01200, rc 0) 00000100:00100000:1.0:1788845971.993550:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+9:10272:x1875740720129024:12345-192.168.206.48@tcp:101:lctl.0 Request processed in 305us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845971.993556:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:1.0:1788845972.052845:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845972.053051:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720129152 00000100:00100000:3.0:1788845972.053140:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720129152 00000100:00100000:3.0:1788845972.053267:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:3.0:1788845972.053279:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+9:10278:x1875740720129152:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1788845972.053366:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845972.053385:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f201 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd20 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053440:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f208 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053455:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f208 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053479:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f208 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053494:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f20f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053516:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f20f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053523:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f20f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053674:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f56600/0x1345bc80c773f216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053684:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f56600/0x1345bc80c773f216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053691:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f56600/0x1345bc80c773f216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845972.053782:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788845972.053786:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845972.053825:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f56600/0x1345bc80c773f216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053836:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f208 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053843:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f208 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053849:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f208 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053855:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845972.053860:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f208 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053968:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f208 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053983:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:3.0:1788845972.053986:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845972.053990:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f208 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.053996:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f208 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.054009:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f20f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.054015:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f20f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.054021:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f20f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.054027:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845972.054029:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f20f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.054035:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f20f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.054053:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a0c31164b00) 00010000:00010000:3.0:1788845972.054056:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845972.055037:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f20f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.055222:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f20f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.055265:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f201 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd20 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.055278:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f56600/0x1345bc80c773f216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd20 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.055286:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:3.0:1788845972.055354:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788845972.055357:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f56600, rc 0) 00000100:00100000:3.0:1788845972.055422:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+10:10278:x1875740720129152:12345-192.168.206.48@tcp:101:bash.0 Request processed in 2145us (2584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845972.055430:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:0.0:1788845972.061966:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845972.062079:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720129408 00000100:00100000:1.0:1788845972.062100:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720129408 00000100:00100000:1.0:1788845972.062181:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:1.0:1788845972.062191:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+10:10278:x1875740720129408:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788845972.062210:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845972.062229:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f21d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd27 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.062346:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f224 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.062360:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f224 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.062370:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f224 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.062430:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f22b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.062438:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f22b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.062445:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f22b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845972.063058:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788845972.063234:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.063245:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.063263:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.063516:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f224 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.063524:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f224 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.063531:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f224 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.063536:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845972.063540:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f224 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.063546:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f224 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.063558:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:1.0:1788845972.063561:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845972.063565:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f224 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.063571:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f224 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845972.063584:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1e357a7 reply state 00000000de249ff6 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f22b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845972.063656:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788845972.063693:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f21d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd27 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.064845:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd27 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.064857:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c10382600) 00010000:00010000:1.0:1788845972.064860:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845972.064863:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00e00, rc 0) 00000100:00100000:1.0:1788845972.065037:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+13:10278:x1875740720129408:12345-192.168.206.48@tcp:101:bash.0 Request processed in 2846us (3085us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788845972.065057:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00010000:00010000:3.0:1788845972.069810:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f22b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.069827:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f22b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.069835:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f22b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.069841:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845972.069846:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f22b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.069854:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f22b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.069884:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c10382f00) 00010000:00010000:3.0:1788845972.069887:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845972.069892:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f22b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.069898:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f22b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845972.070697:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845972.070949:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720129536 00000100:00100000:1.0:1788845972.070958:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720129536 00000100:00100000:1.0:1788845972.071001:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:1.0:1788845972.071009:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875740720129536:12345-192.168.206.48@tcp:8:bash.0 00010000:00080000:1.0:1788845972.071037:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:1.0:1788845972.071073:0:6689:0:(genops.c:1385:class_connect()) connect: client 4592a189-21d8-449a-9335-07bfe0dc7877, cookie 0x1345bc80c773f240 00002000:00100000:1.0:1788845972.071085:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4592a189-21d8-449a-9335-07bfe0dc7877/ffff9a0c074ba800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788845972.071106:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788845972.071345:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788845972.071373:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9a0c074bd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845972.071441:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2350:x1875740720129536:12345-192.168.206.48@tcp:8:bash.0 Request processed in 432us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845972.071448:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1788845972.076008:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845972.076105:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720129664 00000100:00100000:2.0:1788845972.076113:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720129664 00000100:00100000:2.0:1788845972.076214:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:2.0:1788845972.076224:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:0:x1875740720129664:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788845972.076241:0:8094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845972.076261:0:8094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039b597a7/0x1345bc80c773f247 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd2e expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845972.076285:0:8094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788845972.076313:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=304s v=(0 0) 00010000:00010000:2.0:1788845972.076317:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845972.076340:0:8094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039b597a7/0x1345bc80c773f247 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd2e expref: 7 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.076361:0:8094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039b597a7/0x1345bc80c773f247 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd2e expref: 7 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.076374:0:8094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030e00, rc 0) 00000100:00100000:2.0:1788845972.076420:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+7:0:x1875740720129664:12345-192.168.206.48@tcp:101:bash.0 Request processed in 198us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845972.076433:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00080000:0.0:1788845972.076702:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788845972.082282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845972.082432:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720129792 00000100:00100000:0.0:1788845972.082442:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720129792 00000100:00100000:0.0:1788845972.082561:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:0.0:1788845972.082572:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+7:10278:x1875740720129792:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788845972.082600:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845972.082620:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd35 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.082658:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039b597a7/0x1345bc80c773f247 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd2e expref: 8 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.082667:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845972.082671:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845972.082677:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.082740:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039b597a7/0x1345bc80c773f247 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd2e expref: 8 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.082766:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039b597a7/0x1345bc80c773f247 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd2e expref: 8 pid: 8094 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845972.082779:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1875740739034752:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845972.082875:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c41752cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845972.085825:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1875740739034752:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788845972.085857:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.085923:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcee00, rc 0) 00000100:00100000:0.0:1788845972.086059:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+8:10278:x1875740720129792:12345-192.168.206.48@tcp:101:bash.0 Request processed in 3488us (3784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845972.086067:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1788845972.087524:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845972.087811:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720129920 00000100:00100000:0.0:1788845972.087820:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720129920 00010000:00010000:0.0:1788845972.087855:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039b597a7/0x1345bc80c773f247 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd2e expref: 8 pid: 8094 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845972.087904:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:0.0:1788845972.087914:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:2354:x1875740720129920:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845972.087928:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845972.087948:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039b597a7/0x1345bc80c773f247 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd2e expref: 8 pid: 8094 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.088096:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039b597a7/0x1345bc80c773f247 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd2e expref: 8 pid: 8094 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.088120:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039b597a7/0x1345bc80c773f247 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd2e expref: 8 pid: 8094 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.088136:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845972.088140:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845972.088148:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.088211:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.088245:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845972.088258:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5832:1875740739034880:192.168.206.48@tcp:105: 00000100:00100000:0.0:1788845972.088391:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c41752cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845972.098691:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845972.098784:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720130176 00000100:00100000:2.0:1788845972.098794:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720130176 00000100:00100000:2.0:1788845972.098850:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1788845972.098861:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+12:10278:x1875740720130176:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:2.0:1788845972.099228:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+13:10278:x1875740720130176:12345-192.168.206.48@tcp:35:bash.0 Request processed in 368us (544us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788845972.099236:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1788845972.099946:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5832:1875740739034880:192.168.206.48@tcp:105: 00010000:00010000:0.0:1788845972.100129:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845972.100925:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2354:x1875740720129920:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 13007us (13403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845972.100935:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00010000:00010000:0.0:1788845972.134378:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845972.193473:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845972.193637:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720130432 00000100:00100000:2.0:1788845972.193647:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720130432 00000100:00100000:2.0:1788845972.193739:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:2.0:1788845972.193750:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+13:10288:x1875740720130432:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845972.193774:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845972.193793:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd3c expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845972.193878:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788845972.194008:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f255 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd3c expref: 15 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.194022:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:2.0:1788845972.194026:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845972.194030:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd3c expref: 15 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.194054:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030c00, rc 0) 00000100:00100000:2.0:1788845972.194117:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+14:10288:x1875740720130432:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 362us (644us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788845972.194126:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:3.0:1788845972.196678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845972.196869:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720130688 00000100:00100000:1.0:1788845972.196878:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720130688 00000100:00100000:1.0:1788845972.196942:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1788845972.196952:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+14:10288:x1875740720130688:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1788845972.197657:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+15:10288:x1875740720130688:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 704us (986us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788845972.197666:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1788845972.266102:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845972.266212:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720130816 00000100:00100000:2.0:1788845972.266223:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720130816 00000100:00100000:2.0:1788845972.266277:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:2.0:1788845972.266287:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+15:10294:x1875740720130816:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845972.266310:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845972.266329:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f263 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd43 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.266392:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f26a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.266406:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f26a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.266417:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f26a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845972.266463:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788845972.266467:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845972.266484:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f26a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.266510:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f263 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd43 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.266527:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f26a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd43 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.266535:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:2.0:1788845972.266538:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845972.266541:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030e00, rc 0) 00000100:00100000:2.0:1788845972.266602:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+16:10294:x1875740720130816:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 317us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845972.266609:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:0.0:1788845972.272558:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845972.272669:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720131072 00000100:00100000:3.0:1788845972.272678:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720131072 00000100:00100000:3.0:1788845972.272735:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:3.0:1788845972.272744:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+16:10294:x1875740720131072:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845972.272763:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845972.272781:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f271 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd4a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.272862:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f278 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.272877:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f278 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.272887:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f278 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845972.273262:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788845972.273392:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f271 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd4a expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.273409:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f278 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd4a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.273416:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c10382600) 00010000:00010000:3.0:1788845972.273419:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845972.273422:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f57600, rc 0) 00000100:00100000:3.0:1788845972.273525:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+18:10294:x1875740720131072:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 782us (974us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788845972.273533:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:3.0:1788845972.277602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845972.277683:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720131328 00000100:00100000:2.0:1788845972.277692:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720131328 00000100:00100000:2.0:1788845972.277746:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:2.0:1788845972.277756:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+18:10294:x1875740720131328:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845972.277777:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845972.277794:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f286 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd51 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.277874:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f28d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.277915:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f28d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.277926:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f28d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845972.277939:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788845972.278064:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f286 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd51 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.278092:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f28d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd51 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.278101:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c10382600) 00010000:00010000:2.0:1788845972.278105:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788845972.278108:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00031000, rc 0) 00000100:00100000:2.0:1788845972.278361:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+20:10294:x1875740720131328:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 606us (781us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788845972.278369:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:1.0:1788845972.288307:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845972.288393:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845972.288461:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720131584 00000100:00100000:2.0:1788845972.288471:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720131584 00000100:00100000:2.0:1788845972.288531:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:2.0:1788845972.288542:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2352:x1875740720131584:12345-192.168.206.48@tcp:1:lfs.0 00010000:00010000:2.0:1788845972.288595:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.288618:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.288640:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845972.288645:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788845972.288649:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.288687:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.288701:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 7 pid: 6688 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845972.288716:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d667800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875740739035008:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845972.288810:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c26024b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845972.291456:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720131456 00000100:00100000:0.0:1788845972.291468:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720131456 00000100:00100000:0.0:1788845972.291571:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:0.0:1788845972.291583:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+20:2353:x1875740720131456:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845972.291608:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845972.291641:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f278 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd4a expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.291659:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c10382600) 00010000:00010000:0.0:1788845972.291663:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845972.291718:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+19:2353:x1875740720131456:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 137us (3418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845972.291726:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:2.0:1788845972.292090:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d667800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875740739035008:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845972.292112:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845972.292435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845972.292507:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720131712 00000100:00100000:2.0:1788845972.292512:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720131712 00002000:00100000:2.0:1788845972.292543:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9a0c2060b100 x1875740720131712/t0(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:323/0 lens 504/0 e 0 to 0 dl 1788845983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788845972.292553:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c2060b100 with x1875740720131712 ext(0->12) 00010000:00010000:2.0:1788845972.292560:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 8 pid: 6688 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.292598:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 8 pid: 6688 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845972.292607:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a0c2060b100 00000100:00100000:2.0:1788845972.292633:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:2.0:1788845972.292642:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c2060b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4592a189-21d8-449a-9335-07bfe0dc7877+8:2354:x1875740720131712:12345-192.168.206.48@tcp:4:lfs.0 00000001:00100000:1.0:1788845972.314217:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4592a189-21d8-449a-9335-07bfe0dc7877 00000100:00100000:3.0:1788845972.314863:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c2060b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4592a189-21d8-449a-9335-07bfe0dc7877+9:2354:x1875740720131712:12345-192.168.206.48@tcp:4:lfs.0 Request processed in 22216us (22422us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788845972.314880:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00002000:00100000:3.0:1788845972.315533:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9a0c2060b100 x1875740720131712/t4294967299(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:323/0 lens 504/448 e 0 to 0 dl 1788845983 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845972.315545:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c2060b100 with x1875740720131712 ext(0->12) 00010000:00010000:3.0:1788845972.315556:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 9 pid: 6688 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.315574:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 9 pid: 6688 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845972.317536:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a0c2060b100 00000100:00100000:1.0:1788845972.317775:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845972.317975:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720131840 00000100:00100000:3.0:1788845972.317984:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720131840 00010000:00010000:3.0:1788845972.318016:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 9 pid: 6688 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845972.318060:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:3.0:1788845972.318070:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+9:2351:x1875740720131840:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845972.318086:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788845972.318102:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788845972.318105:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788845971 00002000:00010000:3.0:1788845972.318107:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788845972 00002000:00010000:3.0:1788845972.318267:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788845971 00010000:00010000:3.0:1788845972.318277:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 9 pid: 6688 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.318291:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 9 pid: 6688 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.318318:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000042512d9/0x1345bc80c773f24e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd35 expref: 9 pid: 6688 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.318333:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845972.318337:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845972.318343:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.318352:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.318398:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845972.318451:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+8:2351:x1875740720131840:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 382us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845972.318458:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00010000:00010000:0.0:1788845972.319656:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.319671:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.319701:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.319708:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.319734:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.319740:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788845972.319745:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.319753:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.319769:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.319777:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f29b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845972.319858:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2352:x1875740720131584:12345-192.168.206.48@tcp:1:lfs.0 Request processed in 31316us (31463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845972.319868:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:1.0:1788845972.323218:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845972.323380:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720132096 00000100:00100000:3.0:1788845972.323390:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720132096 00000100:00100000:3.0:1788845972.323460:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:3.0:1788845972.323472:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+19:10294:x1875740720132096:12345-192.168.206.48@tcp:35:lfs.0 00000004:00010000:3.0:1788845972.323530:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f28d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd51 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788845972.323831:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788845972.323889:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788845972.326149:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788845972.326250:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.326270:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f232 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd27 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.326278:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.326316:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd27 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.326334:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f232 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd27 expref: 23 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845972.326349:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d667800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875740739035136:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845972.326433:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c222d3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788845972.330003:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845972.330130:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d667800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875740739035136:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845972.330206:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845972.330290:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720132224 00000100:00100000:0.0:1788845972.330298:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720132224 00010000:00010000:0.0:1788845972.330333:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f232 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd27 expref: 24 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845972.330371:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:0.0:1788845972.330387:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+24:2353:x1875740720132224:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845972.330401:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845972.330409:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f232 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd27 expref: 24 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.330420:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd27 expref: 24 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.330441:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd27 expref: 24 pid: 5845 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.330456:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c10382600) 00010000:00010000:0.0:1788845972.330460:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.330468:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.330475:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.330494:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845972.330539:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+23:2353:x1875740720132224:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 153us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845972.330546:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00010000:00010000:1.0:1788845972.330885:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845972.330893:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788845972.331007:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788845972.331484:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788845972.331743:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf68e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875740739035264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788845972.331831:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845972.331903:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074aacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845972.337444:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739035264 00000100:00100000:0.0:1788845972.337458:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739035264 00000100:00100000:0.0:1788845972.337522:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845972.337531:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875740739035264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788845972.337673:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875740739035264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 143us (5842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845972.337681:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845972.337733:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf68e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875740739035264:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1788845972.337825:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788845972.338549:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788845972.338634:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875740739035392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788845972.338677:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845972.338740:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c41752d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788845972.339358:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739035392 00000100:00100000:1.0:1788845972.339366:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739035392 00000100:00100000:1.0:1788845972.339408:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845972.339417:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875740739035392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788845972.339640:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875740739035392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 223us (961us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788845972.339648:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788845972.339743:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875740739035392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788845972.339799:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788845972.339842:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.339852:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.339859:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.339865:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845972.339869:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.339877:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.339892:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c10382600) 00010000:00010000:2.0:1788845972.339896:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788845972.339900:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.339907:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f2a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788845972.340089:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788845972.340330:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788845972.340341:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 304557186568ns, next at 305557184663ns, rc = 0 00000001:00080000:2.0:1788845972.340348:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788845972.340380:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c10382600) 00010000:00010000:2.0:1788845972.340383:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788845972.340389:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f28d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd51 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845972.340479:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+26:10294:x1875740720132096:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 17009us (17268us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788845972.340487:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000020:00080000:2.0:1788845972.340491:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788845972.344321:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845972.344413:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720132352 00000100:00100000:0.0:1788845972.344423:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720132352 00000100:00100000:0.0:1788845972.344514:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:0.0:1788845972.344524:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+26:10294:x1875740720132352:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845972.344547:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845972.344569:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f2a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd58 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.344641:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f2a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd58 expref: 27 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.344656:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f2a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd58 expref: 27 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.344676:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:0.0:1788845972.344679:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788845972.344683:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcee00, rc 0) 00000100:00100000:0.0:1788845972.344740:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+27:10294:x1875740720132352:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 217us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845972.344748:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:1.0:1788845972.351090:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845972.351195:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720132608 00000100:00100000:2.0:1788845972.351204:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720132608 00000100:00100000:2.0:1788845972.351251:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1788845972.351261:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08dc1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+27:10294:x1875740720132608:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788845972.351470:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08dc1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+28:10294:x1875740720132608:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 210us (387us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788845972.351477:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:1.0:1788845972.438764:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845972.438858:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720132864 00000100:00100000:0.0:1788845972.438868:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720132864 00000100:00100000:0.0:1788845972.438929:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:0.0:1788845972.438939:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+28:10305:x1875740720132864:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845972.438964:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845972.438984:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f2b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd5f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845972.439077:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788845972.439241:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f2b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd5f expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.439255:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:0.0:1788845972.439258:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845972.439263:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f2b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd5f expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.439275:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce600, rc 0) 00000100:00100000:0.0:1788845972.439325:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+29:10305:x1875740720132864:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 387us (568us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788845972.439332:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:1.0:1788845972.453768:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845972.453877:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720132992 00000100:00100000:3.0:1788845972.453887:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720132992 00000100:00100000:3.0:1788845972.453944:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:3.0:1788845972.453954:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+29:10305:x1875740720132992:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:3.0:1788845972.454021:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f2be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454036:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f2be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454061:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f2be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454095:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f2c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454103:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454110:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454238:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454248:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454255:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845972.454293:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454305:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f2be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454311:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f2be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454318:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f2be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454324:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845972.454328:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f2be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454343:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f2be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454355:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:3.0:1788845972.454358:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845972.454362:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f2be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454369:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f2be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454383:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454390:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f2c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454397:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454402:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845972.454405:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454412:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f2c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454419:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c31164700) 00010000:00010000:3.0:1788845972.454422:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845972.454424:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f2c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454441:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f2c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454457:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454464:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454469:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454473:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845972.454477:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454483:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454491:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:3.0:1788845972.454493:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845972.454496:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.454501:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845972.454650:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+29:10305:x1875740720132992:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 626us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845972.454660:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:1.0:1788845972.457054:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845972.457290:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720133248 00000100:00100000:2.0:1788845972.457300:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720133248 00000100:00100000:2.0:1788845972.457398:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:2.0:1788845972.457409:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+29:10305:x1875740720133248:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788845972.457621:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+30:10305:x1875740720133248:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 213us (585us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788845972.457630:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:2.0:1788845972.491423:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845972.491585:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720133504 00000100:00100000:0.0:1788845972.491604:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720133504 00000100:00100000:0.0:1788845972.491659:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:0.0:1788845972.491669:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+30:10308:x1875740720133504:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845972.491692:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845972.491711:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f2d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd66 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.491783:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f2da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.491797:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f2da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.491807:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f2da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.491821:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f2e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.491829:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.491835:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.491946:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f2e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.491955:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.491963:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845972.491971:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788845972.492064:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f2da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.492071:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f2da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.492089:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f2da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.492096:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845972.492101:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f2da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.492109:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f2da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.492122:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:0.0:1788845972.492125:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845972.492130:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f2da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.492136:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f2da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.494503:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.494512:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f2e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.494520:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.494526:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845972.494530:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.494555:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f2e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.494569:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c11677900) 00010000:00010000:0.0:1788845972.494572:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845972.494576:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f2e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.494582:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f2e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.494642:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f2d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd66 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.494656:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f2e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd66 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.494663:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:0.0:1788845972.494665:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845972.494667:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcfe00, rc 0) 00000100:00100000:0.0:1788845972.494738:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+32:10308:x1875740720133504:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 3070us (3328us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788845972.494747:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:1.0:1788845972.497846:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845972.497933:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720133632 00000100:00100000:3.0:1788845972.497943:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720133632 00000100:00100000:3.0:1788845972.497999:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:3.0:1788845972.498010:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+32:10308:x1875740720133632:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:3.0:1788845972.498085:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.498101:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.498112:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.498136:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.498142:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.498149:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.498193:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845972.498198:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.498205:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.498217:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:3.0:1788845972.498220:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788845972.498224:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.498242:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845972.498528:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+32:10308:x1875740720133632:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 518us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845972.498536:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:1.0:1788845972.506197:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845972.506345:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720133888 00000100:00100000:0.0:1788845972.506363:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720133888 00000100:00100000:0.0:1788845972.506415:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1788845972.506426:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+32:10308:x1875740720133888:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788845972.506882:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+33:10308:x1875740720133888:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 456us (692us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788845972.506890:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:2.0:1788845972.751775:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845972.751879:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720134144 00000100:00100000:3.0:1788845972.751889:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720134144 00000100:00100000:3.0:1788845972.751952:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:3.0:1788845972.751962:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+33:10339:x1875740720134144:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:3.0:1788845972.751989:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845972.752008:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd6d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.752111:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f304 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.752125:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.752137:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845972.752148:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788845972.752305:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f2fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd6d expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.752323:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd6d expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.752343:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:3.0:1788845972.752346:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845972.752361:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f57800, rc 0) 00000100:00100000:3.0:1788845972.752469:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+35:10339:x1875740720134144:12345-192.168.206.48@tcp:101:cat.0 Request processed in 509us (703us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788845972.752477:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:1.0:1788845972.756232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845972.756343:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720134272 00000100:00100000:0.0:1788845972.756417:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720134272 00000100:00100000:0.0:1788845972.756482:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:0.0:1788845972.756492:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26396450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+35:2352:x1875740720134272:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845972.756508:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845972.756543:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f304 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd6d expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.756562:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:0.0:1788845972.756567:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845972.756620:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26396450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+34:2352:x1875740720134272:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 130us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845972.756628:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1788845972.757501:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845972.757627:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720134528 00000100:00100000:0.0:1788845972.757634:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720134528 00000100:00100000:0.0:1788845972.757675:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:0.0:1788845972.757685:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+34:10339:x1875740720134528:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:0.0:1788845972.758049:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+35:10339:x1875740720134528:12345-192.168.206.48@tcp:35:cat.0 Request processed in 355us (540us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788845972.758057:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:2.0:1788845972.821830:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845972.821954:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720134784 00000100:00100000:0.0:1788845972.821963:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720134784 00000100:00100000:0.0:1788845972.822110:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:0.0:1788845972.822132:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+35:10345:x1875740720134784:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:0.0:1788845972.822183:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845972.822186:0:7134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788845972.822211:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f26a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd43 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.822227:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:0.0:1788845972.822236:0:7134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845972.822249:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f312 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd74 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.822338:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.822351:0:7134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f2e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd66 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.822359:0:7134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.822387:0:7134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f2e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd66 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.822399:0:7134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f2e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd66 expref: 35 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845972.822421:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739035520:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845972.822496:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c417529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845972.831559:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739035520:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788845972.831589:0:7134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845972.832433:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845972.833721:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720134912 00000100:00100000:0.0:1788845972.833732:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720134912 00010000:00010000:0.0:1788845972.833769:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f2e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd66 expref: 36 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845972.833809:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:0.0:1788845972.833817:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d667480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+36:2354:x1875740720134912:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845972.833830:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845972.833836:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f2e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd66 expref: 36 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.833848:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f2e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd66 expref: 36 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.833868:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f2e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd66 expref: 36 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.833882:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:0.0:1788845972.833887:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.833896:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.833904:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.833943:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845972.833992:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d667480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+35:2354:x1875740720134912:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 176us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845972.833999:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00010000:00010000:2.0:1788845972.834075:0:7134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.834083:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845972.834099:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788845972.834261:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f312 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd74 expref: 36 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.834275:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd74 expref: 35 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.834282:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:2.0:1788845972.834285:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788845972.834288:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce400, rc 0) 00000100:00100000:2.0:1788845972.834310:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+35:10345:x1875740720134784:12345-192.168.206.48@tcp:101:dd.0 Request processed in 12181us (12489us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788845972.834318:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:1.0:1788845972.838683:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845972.839035:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720135168 00000100:00100000:3.0:1788845972.839056:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720135168 00000100:00100000:3.0:1788845972.839300:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:3.0:1788845972.839311:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+35:10345:x1875740720135168:12345-192.168.206.48@tcp:36:dd.0 00010000:00010000:3.0:1788845972.839574:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f327 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.839905:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845972.839918:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788845972.839975:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788845972.840001:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002abb562 reply state 0000000006019d08 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845972.840010:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788845972.840251:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+38:10345:x1875740720135168:12345-192.168.206.48@tcp:36:dd.0 Request processed in 940us (1574us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788845972.840259:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00000020:00080000:3.0:1788845972.840276:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788845972.849457:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.849476:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f327 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.849495:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f327 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.849717:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845972.849722:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f327 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.849730:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f327 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.849746:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:0.0:1788845972.849749:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845972.849753:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f327 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845972.849759:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f327 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.158323:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845973.170277:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845973.170442:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720135296 00000100:00100000:3.0:1788845973.170451:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720135296 00000100:00100000:3.0:1788845973.170580:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:3.0:1788845973.170590:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+37:10359:x1875740720135296:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:3.0:1788845973.170613:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845973.170645:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f32e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd7b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.170710:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f335 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.170725:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f335 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.170737:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f335 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.170752:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f33c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.170759:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f33c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.170766:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f33c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.170869:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f343 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.170879:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd74 expref: 38 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.170905:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f343 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.170938:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd74 expref: 38 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.170951:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd74 expref: 38 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845973.170965:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c2060aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739035648:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845973.171070:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b2f900 going to sleep for 11 seconds 00000100:00080000:2.0:1788845973.172417:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845973.173428:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c2060aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739035648:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788845973.173466:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f343 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845973.174416:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845973.174466:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720135552 00000100:00100000:0.0:1788845973.174474:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720135552 00000100:00100000:0.0:1788845973.174528:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:0.0:1788845973.174537:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+39:5589:x1875740720135552:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788845973.175336:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+40:5589:x1875740720135552:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 796us (919us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788845973.175345:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1788845973.178444:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845973.178942:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720135680 00000100:00100000:0.0:1788845973.178952:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720135680 00010000:00010000:0.0:1788845973.178994:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd74 expref: 40 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845973.179248:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:0.0:1788845973.179259:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+40:2354:x1875740720135680:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845973.179272:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845973.179279:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd74 expref: 40 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.179303:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd74 expref: 40 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.179324:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f319 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd74 expref: 40 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.179516:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:0.0:1788845973.179522:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f343 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.179532:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.179540:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f343 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.179758:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845973.179822:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+39:2354:x1875740720135680:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 556us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845973.179830:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00010000:00010000:3.0:1788845973.180644:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.180654:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845973.180693:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788845973.180697:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845973.180738:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.180751:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.180761:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f335 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.180768:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f335 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.180853:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f335 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181117:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845973.181125:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f335 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181136:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f335 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181149:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:3.0:1788845973.181176:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845973.181182:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f335 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181190:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f335 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181206:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f33c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181212:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f33c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181218:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f33c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181223:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845973.181226:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f33c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181253:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f33c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181263:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c31164700) 00010000:00010000:3.0:1788845973.181266:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845973.181269:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f33c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181274:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f33c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181321:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f32e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd7b expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181335:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd7b expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.181343:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:3.0:1788845973.181345:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845973.181347:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475a00, rc 0) 00000100:00100000:3.0:1788845973.181470:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+38:10359:x1875740720135296:12345-192.168.206.48@tcp:101:stat.0 Request processed in 10870us (11192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.181477:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:1.0:1788845973.296334:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845973.301067:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720135936 00000100:00100000:0.0:1788845973.301082:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720135936 00000100:00100000:0.0:1788845973.301174:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:0.0:1788845973.301185:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+38:10365:x1875740720135936:12345-192.168.206.48@tcp:36:truncate.0 00010000:00010000:0.0:1788845973.301241:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845973.301269:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f343 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd7b expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.301288:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:0.0:1788845973.301294:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845973.301624:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f34a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.301639:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f34a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.301661:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f34a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845973.301947:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788845973.301974:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080aae4d4 reply state 00000000ff8d04da transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f34a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845973.301983:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845973.302119:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+40:10365:x1875740720135936:12345-192.168.206.48@tcp:36:truncate.0 Request processed in 935us (5793us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788845973.302127:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 54 00000020:00080000:0.0:1788845973.302131:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788845973.307655:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f34a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.307672:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f34a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.307708:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f34a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.307715:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845973.307719:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f34a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.307728:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f34a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.307744:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:3.0:1788845973.307748:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845973.307753:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f34a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.307759:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f34a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845973.494792:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845973.495002:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720136064 00000100:00100000:0.0:1788845973.495011:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720136064 00000100:00100000:0.0:1788845973.495075:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:0.0:1788845973.495085:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+39:10379:x1875740720136064:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:0.0:1788845973.495107:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845973.495127:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f351 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd82 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495222:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f358 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495238:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495250:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495282:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f35f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495290:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f35f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495296:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f35f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495381:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495389:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495396:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845973.495426:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788845973.495430:0:7134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845973.495449:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495459:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495467:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495472:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f358 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495488:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f358 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495494:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845973.495510:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f358 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495519:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f358 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495530:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:0.0:1788845973.495534:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845973.495539:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f358 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495545:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f358 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495557:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f35f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495563:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f35f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495567:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f35f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495572:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845973.495589:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f35f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495604:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f35f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495612:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c11677900) 00010000:00010000:0.0:1788845973.495615:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845973.495618:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f35f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495623:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f35f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495652:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f351 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd82 expref: 41 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495664:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd82 expref: 40 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.495671:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:0.0:1788845973.495673:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845973.495675:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcf400, rc 0) 00000100:00100000:0.0:1788845973.495744:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+40:10379:x1875740720136064:12345-192.168.206.48@tcp:101:stat.0 Request processed in 660us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845973.495751:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:1.0:1788845973.603007:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845973.603721:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720136320 00000100:00100000:0.0:1788845973.603731:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720136320 00000100:00100000:0.0:1788845973.603805:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:0.0:1788845973.603814:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+40:10389:x1875740720136320:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845973.603850:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845973.603870:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f36d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd89 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845973.603964:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788845973.604483:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f36d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd89 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.604499:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:0.0:1788845973.604502:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845973.604508:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f36d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd89 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.604522:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcfe00, rc 0) 00000100:00100000:0.0:1788845973.604649:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+41:10389:x1875740720136320:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 834us (1649us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788845973.604657:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:1.0:1788845973.610734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845973.614598:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720136576 00000100:00100000:2.0:1788845973.614615:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720136576 00000100:00100000:2.0:1788845973.614755:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:2.0:1788845973.614767:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+41:10389:x1875740720136576:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788845973.614986:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+42:10389:x1875740720136576:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 221us (4260us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788845973.615008:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:1.0:1788845973.687996:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845973.688132:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720136832 00000100:00100000:0.0:1788845973.688143:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720136832 00000100:00100000:0.0:1788845973.688273:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:0.0:1788845973.688284:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+42:10395:x1875740720136832:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788845973.688306:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845973.688325:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f37b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd90 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.688416:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.688447:0:7134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f366 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd82 expref: 43 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.688455:0:7134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.688487:0:7134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd82 expref: 43 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.688501:0:7134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd82 expref: 43 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845973.688514:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739035776:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845973.688635:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c41752e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845973.694191:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739035776:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788845973.694234:0:7134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845973.694478:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845973.695019:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720136960 00000100:00100000:0.0:1788845973.695027:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720136960 00010000:00010000:0.0:1788845973.695073:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd82 expref: 44 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845973.695172:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:0.0:1788845973.695183:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+44:2353:x1875740720136960:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845973.695197:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845973.695225:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd82 expref: 44 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.695237:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd82 expref: 44 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.695259:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f366 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd82 expref: 44 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.695273:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:0.0:1788845973.695277:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.695286:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.695294:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.695323:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845973.695353:0:7134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.695361:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845973.695375:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+43:2353:x1875740720136960:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 195us (898us total) trans 0 rc 0/0 00000004:00200000:2.0:1788845973.695377:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000100:00100000:0.0:1788845973.695383:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00010000:00010000:2.0:1788845973.695503:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f37b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd90 expref: 44 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.695518:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd90 expref: 43 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.695525:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:2.0:1788845973.695528:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788845973.695530:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce000, rc 0) 00000100:00100000:2.0:1788845973.695769:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+43:10395:x1875740720136832:12345-192.168.206.48@tcp:101:bash.0 Request processed in 7486us (7780us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788845973.695776:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:1.0:1788845973.702925:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845973.703402:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720137216 00000100:00100000:3.0:1788845973.703413:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720137216 00000100:00100000:3.0:1788845973.703472:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:3.0:1788845973.703482:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+43:10395:x1875740720137216:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:3.0:1788845973.703741:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f390 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.703760:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f390 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.703772:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f390 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788845973.703852:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788845973.703875:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d33a691c reply state 00000000be7b442c transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f390 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845973.703884:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788845973.703969:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+46:10395:x1875740720137216:12345-192.168.206.48@tcp:36:bash.0 Request processed in 487us (1052us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788845973.703977:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00000020:00080000:3.0:1788845973.703982:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788845973.709498:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845973.709574:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720137344 00000100:00100000:3.0:1788845973.709594:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720137344 00000100:00100000:3.0:1788845973.709647:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:3.0:1788845973.709656:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+46:10395:x1875740720137344:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1788845973.709677:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845973.709695:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f397 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.709765:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f39e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.709778:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd90 expref: 47 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.709786:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f390 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.709793:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f39e lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.709979:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f390 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.710008:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd90 expref: 47 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.710021:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd90 expref: 47 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845973.710044:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c2060bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739035904:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845973.710136:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b2f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845973.711908:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c2060bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739035904:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845973.711935:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f39e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.713255:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f390 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.713269:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f390 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.713277:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f390 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.713301:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845973.713306:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f390 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.713383:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f390 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.713402:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:0.0:1788845973.713405:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845973.713408:0:3294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f39e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.713417:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f390 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.713423:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f390 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845973.713870:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845973.714003:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720137472 00000100:00100000:3.0:1788845973.714012:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720137472 00010000:00010000:3.0:1788845973.714056:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd90 expref: 47 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845973.714240:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:3.0:1788845973.714251:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+47:2354:x1875740720137472:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845973.714265:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845973.714272:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd90 expref: 47 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.714297:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd90 expref: 47 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.714314:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f382 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd90 expref: 47 pid: 7134 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.714326:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:3.0:1788845973.714330:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f39e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.714337:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.714343:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f39e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.714418:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845973.714474:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+46:2354:x1875740720137472:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 224us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.714482:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00010000:00010000:1.0:1788845973.714876:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845973.714964:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845973.715003:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788845973.715008:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845973.715026:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845973.715067:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f397 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd97 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845973.715083:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f39e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd97 expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845973.715090:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:1.0:1788845973.715093:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845973.715096:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474000, rc 0) 00000100:00100000:1.0:1788845973.715216:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+45:10395:x1875740720137344:12345-192.168.206.48@tcp:101:bash.0 Request processed in 5560us (5724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845973.715224:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:1.0:1788845973.717416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845973.717506:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720137728 00000100:00100000:0.0:1788845973.717515:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720137728 00000100:00100000:0.0:1788845973.717623:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:0.0:1788845973.717631:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08dc3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+45:10395:x1875740720137728:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:0.0:1788845973.717937:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08dc3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+46:10395:x1875740720137728:12345-192.168.206.48@tcp:35:bash.0 Request processed in 306us (589us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788845973.717945:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:3.0:1788845973.792836:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845973.793046:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720137984 00000100:00100000:2.0:1788845973.793056:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720137984 00000100:00100000:2.0:1788845973.793192:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:2.0:1788845973.793202:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c2060bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+46:10405:x1875740720137984:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845973.793224:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845973.793245:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f3a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cd9e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845973.793352:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788845973.793458:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f3a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd9e expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.793481:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:2.0:1788845973.793484:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845973.793490:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f3a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd9e expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.793504:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00031600, rc 0) 00000100:00100000:2.0:1788845973.793566:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c2060bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+47:10405:x1875740720137984:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 366us (737us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788845973.793586:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:2.0:1788845973.801144:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845973.801241:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720138112 00000100:00100000:0.0:1788845973.801252:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720138112 00000100:00100000:0.0:1788845973.801520:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:0.0:1788845973.801532:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+47:10405:x1875740720138112:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:0.0:1788845973.801628:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801644:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801658:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801673:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801693:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801700:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801780:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f3c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801789:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801797:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788845973.801847:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801859:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801876:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801883:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801889:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845973.801893:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801900:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801913:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:0.0:1788845973.801915:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845973.801920:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801926:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801938:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801944:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801949:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801953:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845973.801963:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801969:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801977:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c11677900) 00010000:00010000:0.0:1788845973.801979:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845973.801982:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.801988:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.802002:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.802008:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f3c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.802013:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.802018:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845973.802021:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.802027:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f3c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.802044:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:0.0:1788845973.802046:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845973.802055:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f3c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.802062:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f3c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845973.802184:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+47:10405:x1875740720138112:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 624us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845973.802192:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:1.0:1788845973.807307:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845973.807361:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720138368 00000100:00100000:2.0:1788845973.807371:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720138368 00000100:00100000:2.0:1788845973.807419:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1788845973.807429:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+47:10405:x1875740720138368:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788845973.807649:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+48:10405:x1875740720138368:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 219us (348us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788845973.807666:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:3.0:1788845973.855856:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845973.856190:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720138624 00000100:00100000:0.0:1788845973.856200:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720138624 00000100:00100000:0.0:1788845973.856261:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:0.0:1788845973.856270:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c20609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+48:10408:x1875740720138624:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845973.856292:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845973.856311:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f3c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cda5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856379:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856394:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856406:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856420:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856427:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856450:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856555:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f3dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856564:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f3dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856572:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f3dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845973.856701:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788845973.856797:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856806:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856812:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856818:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845973.856822:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856829:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856841:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:0.0:1788845973.856844:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845973.856855:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856861:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f3cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856875:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856881:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856887:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856891:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845973.856895:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856900:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856908:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c11677900) 00010000:00010000:0.0:1788845973.856910:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845973.856913:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.856919:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f3d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.857811:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f3c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cda5 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.857853:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f3dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cda5 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.857861:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:0.0:1788845973.857864:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845973.857867:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcf800, rc 0) 00000100:00100000:0.0:1788845973.857924:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c20609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+50:10408:x1875740720138624:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1654us (2076us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788845973.857932:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:1.0:1788845973.868450:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845973.871150:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720138752 00000100:00100000:3.0:1788845973.871492:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720138752 00000100:00100000:2.0:1788845973.873007:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:2.0:1788845973.873021:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+50:10408:x1875740720138752:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:2.0:1788845973.873097:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f3eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.873124:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f3eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.873135:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f3eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.873194:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f3eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.873201:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f3eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.873208:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f3eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.873214:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845973.873218:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f3eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.873224:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f3eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.873235:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:2.0:1788845973.873238:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845973.873242:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f3eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.873248:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f3eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845973.873330:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+50:10408:x1875740720138752:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 312us (4888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.873344:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:1.0:1788845973.878503:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845973.878583:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720138880 00000100:00100000:3.0:1788845973.878592:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720138880 00000100:00100000:3.0:1788845973.878656:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:3.0:1788845973.878668:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+50:2353:x1875740720138880:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845973.878695:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845973.878719:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f3dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cda5 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.878736:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:3.0:1788845973.878741:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845973.878790:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+49:2353:x1875740720138880:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 124us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.878797:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1788845973.887799:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845973.887871:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720139136 00000100:00100000:0.0:1788845973.887880:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720139136 00000100:00100000:0.0:1788845973.887935:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:0.0:1788845973.887946:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+49:10408:x1875740720139136:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788845973.888516:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+50:10408:x1875740720139136:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 570us (723us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788845973.888525:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:3.0:1788845973.926778:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739036416:0@lo:400:kworker.0 00000100:00100000:3.0:1788845973.926845:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845973.926913:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788845973.926920:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739036032:0@lo:400:kworker.0 00000100:00100000:3.0:1788845973.926948:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845973.926984:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739036544:0@lo:400:kworker.0 00000100:00100000:3.0:1788845973.927008:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845973.927049:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739036160:0@lo:400:kworker.0 00000100:00100000:3.0:1788845973.927072:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845973.927087:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739036672:0@lo:400:kworker.0 00000100:00100000:3.0:1788845973.927105:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845973.927119:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845973.927124:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739036288:0@lo:400:kworker.0 00000100:00100000:3.0:1788845973.927145:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845973.927201:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739036032 00000100:00100000:3.0:1788845973.927208:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739036032 00000100:00100000:3.0:1788845973.927263:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788845973.927272:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739036032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845973.927320:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739036032:12345-0@lo:400:kworker.0 Request processed in 49us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.927327:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788845973.927389:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739036032:0@lo:400:kworker.0 00000100:00100000:3.0:1788845973.927414:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739036544 00000100:00100000:3.0:1788845973.927418:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739036544 00000100:00080000:3.0:1788845973.927438:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845973.927460:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739036160 00000100:00100000:3.0:1788845973.927463:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739036160 00000100:00100000:3.0:1788845973.927475:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739036288 00000100:00100000:3.0:1788845973.927478:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739036288 00000100:00080000:3.0:1788845973.927490:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845973.927504:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788845973.927511:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739036544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845973.927548:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739036544:12345-0@lo:400:kworker.0 Request processed in 38us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.927555:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788845973.927592:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739036544:0@lo:400:kworker.0 00000100:00100000:3.0:1788845973.927852:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788845973.927861:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739036160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845973.927897:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739036160:12345-0@lo:400:kworker.0 Request processed in 39us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.927903:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788845973.927928:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739036160:0@lo:400:kworker.0 00000100:00100000:1.0:1788845973.928062:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739036416 00000100:00100000:1.0:1788845973.928067:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739036416 00000100:00100000:1.0:1788845973.928101:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739036672 00000100:00100000:1.0:1788845973.928111:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739036672 00000100:00100000:1.0:1788845973.928138:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788845973.928145:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c2060aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739036416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845973.928213:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c2060aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739036416:12345-0@lo:400:kworker.0 Request processed in 69us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845973.928218:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788845973.928230:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788845973.928236:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739036672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845973.928263:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739036672:12345-0@lo:400:kworker.0 Request processed in 29us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845973.928268:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788845973.928292:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845973.928310:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739036672:0@lo:400:kworker.0 00000100:00100000:1.0:1788845973.928333:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739036416:0@lo:400:kworker.0 00000100:00100000:3.0:1788845973.928415:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788845973.928423:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739036288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845973.928461:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739036288:12345-0@lo:400:kworker.0 Request processed in 40us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.928467:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788845973.928563:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739036288:0@lo:400:kworker.0 00000004:00080000:2.0:1788845973.928803:0:8093:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306145648079ns, next at 307145646093ns, rc = 0 00000100:00100000:3.0:1788845973.928916:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739036800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845973.928951:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845973.930757:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739036800 00000100:00100000:2.0:1788845973.930767:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739036800 00000100:00100000:2.0:1788845973.930869:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788845973.930880:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875740739036800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845973.930911:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845973.930984:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875740739036800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.930991:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788845973.931082:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739036800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845974.057873:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845974.058376:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720139392 00000100:00100000:3.0:1788845974.058386:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720139392 00000100:00100000:3.0:1788845974.058481:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:3.0:1788845974.058491:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+50:10426:x1875740720139392:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:3.0:1788845974.058524:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845974.058542:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f3f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cdac expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.058631:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f3f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.058646:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.058658:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845974.058669:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788845974.058807:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f3f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdac expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.058825:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdac expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.058834:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:3.0:1788845974.058837:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788845974.058840:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474a00, rc 0) 00000100:00100000:3.0:1788845974.058903:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+52:10426:x1875740720139392:12345-192.168.206.48@tcp:101:cat.0 Request processed in 413us (1038us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788845974.058911:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:1.0:1788845974.088139:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845974.088497:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720139520 00000100:00100000:0.0:1788845974.088507:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720139520 00000100:00100000:0.0:1788845974.088568:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:0.0:1788845974.088579:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+52:10427:x1875740720139520:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845974.088601:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845974.088620:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f407 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cdb3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.088693:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f40e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.088717:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f40e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.088729:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f40e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845974.088759:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788845974.088763:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845974.088778:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f40e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.088802:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f407 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdb3 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.088818:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f40e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdb3 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.088826:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:0.0:1788845974.088829:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845974.088832:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcf400, rc 0) 00000100:00100000:0.0:1788845974.088892:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+53:10427:x1875740720139520:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 316us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845974.088900:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:1.0:1788845974.099693:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845974.100260:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720139904 00000100:00100000:2.0:1788845974.100270:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720139904 00000100:00100000:2.0:1788845974.100375:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1788845974.100386:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+53:10427:x1875740720139904:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788845974.100846:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+54:10427:x1875740720139904:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 460us (1161us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788845974.100855:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1788845974.110476:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845974.110590:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720140032 00000100:00100000:3.0:1788845974.110598:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720140032 00000100:00100000:3.0:1788845974.110646:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:3.0:1788845974.110655:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+54:10427:x1875740720140032:12345-192.168.206.48@tcp:103:lfs.0 00010000:00010000:3.0:1788845974.110668:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788845974.110690:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f39e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd97 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.110712:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f3f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdac expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.110724:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f2a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd58 expref: 52 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.110734:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c11677a00) 00010000:00010000:3.0:1788845974.110755:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845974.110807:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+51:10427:x1875740720140032:12345-192.168.206.48@tcp:103:lfs.0 Request processed in 152us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845974.110815:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1788845974.118094:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845974.118213:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720140160 00000100:00100000:2.0:1788845974.118224:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720140160 00000100:00100000:2.0:1788845974.118273:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:2.0:1788845974.118283:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+51:10427:x1875740720140160:12345-192.168.206.48@tcp:58:lfs.0 00010000:00010000:2.0:1788845974.118389:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f415 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.118405:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f415 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.118440:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f415 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788845974.119734:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788845974.120757:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788845974.120835:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788845974.121698:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+51:10427:x1875740720140160:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 3409us (3605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845974.121709:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:1.0:1788845974.137777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845974.138920:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720140288 00000100:00100000:2.0:1788845974.138931:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720140288 00000100:00100000:2.0:1788845974.138997:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:2.0:1788845974.139007:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+51:10429:x1875740720140288:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845974.139024:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845974.139052:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f41c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cdba expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139110:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f423 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139123:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f423 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139134:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f423 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139147:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f42a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139209:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139216:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139293:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139301:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139308:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845974.139337:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788845974.139341:0:7134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845974.139358:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139369:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139376:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f423 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139382:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f423 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139388:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f423 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139403:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845974.139407:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f423 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139414:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f423 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139426:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:2.0:1788845974.139429:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845974.139433:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f423 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139439:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f423 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139452:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139458:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f42a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139464:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f42a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139468:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845974.139471:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f42a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139476:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f42a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139494:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845974.139497:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845974.139499:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f42a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139506:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f42a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139536:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f41c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdba expref: 53 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139549:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdba expref: 52 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.139556:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fe00) 00010000:00010000:2.0:1788845974.139558:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845974.139561:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030e00, rc 0) 00000100:00100000:2.0:1788845974.139621:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+52:10429:x1875740720140288:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 616us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845974.139628:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 67 00010000:00010000:1.0:1788845974.185797:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845974.432625:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845974.432685:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845974.432720:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845974.432751:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845974.432769:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720140416 00000100:00100000:1.0:1788845974.432779:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720140544 00000100:00100000:0.0:1788845974.432779:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720140416 00000100:00100000:1.0:1788845974.432798:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720140544 00000100:00100000:0.0:1788845974.432830:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 278 00000100:00100000:1.0:1788845974.432836:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720140800 00000100:00100000:1.0:1788845974.432841:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720140800 00000100:00100000:0.0:1788845974.432842:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:2351:x1875740720140416:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845974.432872:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 110 00000100:00100000:1.0:1788845974.432880:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+52:2352:x1875740720140544:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788845974.432917:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:2351:x1875740720140416:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 77us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845974.432922:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+52:2352:x1875740720140544:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 42us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845974.432936:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 111 00000100:00100000:0.0:1788845974.432941:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 278 00000100:00100000:1.0:1788845974.432948:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 110 00000100:00100000:3.0:1788845974.432950:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720140800:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845974.432977:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720140672 00000100:00100000:1.0:1788845974.432982:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720140672 00000100:00100000:3.0:1788845974.432985:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720140800:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 40us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845974.432995:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 111 00000100:00100000:1.0:1788845974.433043:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:1.0:1788845974.433052:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2351:x1875740720140672:12345-192.168.206.48@tcp:400:kworker.0 00000100:00080000:3.0:1788845974.433059:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845974.433065:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845974.433088:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2351:x1875740720140672:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 38us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845974.433097:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000040:00080000:3.0:1788845974.778337:0:11993:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788845974.778346:0:11993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788845974.778384:0:11993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788845974.778389:0:11993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788845974.886393:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788845974.886403:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788845974.886447:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788845974.886454:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788845974.886566:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d666680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875740739036928:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788845974.886656:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c263e5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788845974.901368:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845974.901438:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720140928 00000100:00100000:0.0:1788845974.901447:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720140928 00000100:00100000:0.0:1788845974.901498:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:0.0:1788845974.901507:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4592a189-21d8-449a-9335-07bfe0dc7877+53:10441:x1875740720140928:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788845974.901579:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4592a189-21d8-449a-9335-07bfe0dc7877+53:10441:x1875740720140928:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 Request processed in 73us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845974.901587:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:2.0:1788845974.901661:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d666680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875740739036928:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788845974.904011:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845974.904086:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720141056 00000100:00100000:2.0:1788845974.904095:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720141056 00000100:00100000:2.0:1788845974.904146:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:2.0:1788845974.904181:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+52:10441:x1875740720141056:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788845974.904208:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788845974.904299:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+52:10441:x1875740720141056:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 121us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845974.904306:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:1.0:1788845974.911882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845974.911950:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720141184 00000100:00100000:3.0:1788845974.911960:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720141184 00000100:00100000:1.0:1788845974.912067:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:1.0:1788845974.912083:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+52:10441:x1875740720141184:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788845974.912150:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f438 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912196:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f438 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912209:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f438 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912233:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f43f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912241:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f43f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912248:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f43f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912273:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f446 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912281:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912288:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845974.912320:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788845974.912324:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845974.912338:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912348:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f438 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912356:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f438 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912364:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f438 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912381:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845974.912386:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f438 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912393:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f438 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912406:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f200) 00010000:00010000:1.0:1788845974.912409:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845974.912413:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f438 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912419:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f438 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912432:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f43f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912438:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f43f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912445:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f43f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912450:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845974.912453:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f43f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912459:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f43f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912476:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9a0c10382000) 00010000:00010000:1.0:1788845974.912479:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845974.912482:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f43f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912487:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f43f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912500:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912507:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f446 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912513:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912517:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845974.912520:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912526:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f446 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912532:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fe00) 00010000:00010000:1.0:1788845974.912535:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845974.912538:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f446 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845974.912543:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f446 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845974.912627:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+52:10441:x1875740720141184:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 549us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845974.912635:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:3.0:1788845974.915239:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845974.915322:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720141440 00000100:00100000:2.0:1788845974.915331:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720141440 00000100:00100000:2.0:1788845974.915383:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:2.0:1788845974.915393:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+52:10441:x1875740720141440:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845974.915411:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845974.915428:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f44d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cdc1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.915525:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f454 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.915541:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.915553:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845974.915563:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788845974.915657:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.915675:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f454 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.915682:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.915688:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845974.915693:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.915700:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f454 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.915712:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fe00) 00010000:00010000:2.0:1788845974.915716:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845974.915720:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f454 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.915726:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f454 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.915763:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f44d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdc1 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.915773:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f200) 00010000:00010000:2.0:1788845974.915775:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845974.915779:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f44d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdc1 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.915798:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030000, rc 0) 00000100:00100000:2.0:1788845974.915852:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+53:10441:x1875740720141440:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 461us (620us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788845974.915860:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:1.0:1788845974.927467:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845974.927502:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720141568 00000100:00100000:1.0:1788845974.927511:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720141568 00000100:00100000:1.0:1788845974.929102:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:1.0:1788845974.929115:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+53:10441:x1875740720141568:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788845974.929166:0:7134:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788845974.929266:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+53:10441:x1875740720141568:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 153us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845974.929275:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:1.0:1788845974.937781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845974.937882:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720141824 00000100:00100000:0.0:1788845974.937892:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720141824 00000100:00100000:0.0:1788845974.937957:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:0.0:1788845974.937968:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+53:10441:x1875740720141824:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845974.937986:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845974.937989:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788845974.938015:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f40e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdb3 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.938046:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:0.0:1788845974.938051:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845974.938065:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f462 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cdc8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788845974.938559:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788845974.938766:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.938793:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.938803:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.938853:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f462 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdc8 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.938867:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdc8 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.938881:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a0c11677900) 00010000:00010000:0.0:1788845974.938884:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845974.938890:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce000, rc 0) 00000100:00100000:0.0:1788845974.938956:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+54:10441:x1875740720141824:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 989us (1182us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788845974.938964:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:1.0:1788845974.951642:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845974.955827:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720142080 00000100:00100000:3.0:1788845974.955841:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720142080 00000100:00100000:3.0:1788845974.955908:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:3.0:1788845974.955919:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+54:10441:x1875740720142080:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788845974.955973:0:7134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845974.955999:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f469 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdc8 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956017:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a0c11677900) 00010000:00010000:3.0:1788845974.956050:0:7134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845974.956072:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f477 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956085:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f477 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956095:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f477 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956183:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f47e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x64c15475 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956192:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f47e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x64c15475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956199:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f47e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x64c15475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956257:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f477 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956265:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f477 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956271:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f477 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956277:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845974.956281:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f477 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956289:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f477 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956305:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:3.0:1788845974.956308:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845974.956312:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f477 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956319:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f477 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956328:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f47e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x64c15475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956335:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f47e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x64c15475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956341:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f47e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x64c15475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956345:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845974.956348:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f47e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x64c15475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956353:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f47e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x64c15475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956361:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x64c15475 (ffff9a0c31164700) 00010000:00010000:3.0:1788845974.956363:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845974.956366:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f47e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x64c15475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.956371:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f47e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x64c15475 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845974.956463:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+53:10441:x1875740720142080:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 545us (4825us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788845974.956471:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:0.0:1788845974.964968:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845974.965050:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720142208 00000100:00100000:2.0:1788845974.965059:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720142208 00000100:00100000:2.0:1788845974.965114:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:2.0:1788845974.965124:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+53:10441:x1875740720142208:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845974.965144:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845974.965211:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f485 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cdcf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.965247:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f48c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.965260:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f48c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.965270:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f48c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.965362:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f485 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdcf expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.965380:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f48c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdcf expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.965388:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845974.965391:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788845974.965401:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00031000, rc 0) 00000100:00100000:2.0:1788845974.965451:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+54:10441:x1875740720142208:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 328us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845974.965458:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:1.0:1788845974.968225:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845974.968277:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720142464 00000100:00100000:3.0:1788845974.968287:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720142464 00000100:00100000:0.0:1788845974.968360:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:0.0:1788845974.968373:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+54:10441:x1875740720142464:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788845974.968450:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f493 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.968467:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f493 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845974.968478:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f493 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788845974.968746:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1788845974.968756:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307185601679ns, next at 308185599481ns, rc = 0 00000004:00010000:0.0:1788845974.968840:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081d4069e reply state 000000005d222520 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f493 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845974.968850:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845974.968939:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+56:10441:x1875740720142464:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 568us (722us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788845974.968947:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 75 00010000:00010000:3.0:1788845974.971132:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f493 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.971147:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f493 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.971238:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f493 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.971245:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845974.971249:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f493 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.971257:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f493 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.971273:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:3.0:1788845974.971276:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788845974.971280:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f493 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845974.971286:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f493 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845974.971418:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845974.971549:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720142592 00000100:00100000:2.0:1788845974.971558:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720142592 00000100:00100000:2.0:1788845974.971617:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:2.0:1788845974.971628:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+55:10441:x1875740720142592:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845974.971650:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845974.971665:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f49a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cdd6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.971717:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f49a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdd6 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.971730:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f49a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdd6 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845974.971747:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845974.971749:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788845974.971752:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030c00, rc 0) 00000100:00100000:2.0:1788845974.971810:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+56:10441:x1875740720142592:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 184us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845974.971817:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:1.0:1788845974.977501:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845974.977659:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720142720 00000100:00100000:2.0:1788845974.977669:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720142720 00000100:00100000:2.0:1788845974.977724:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:2.0:1788845974.977731:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875740720142720:12345-192.168.206.48@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788845974.977775:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:2.0:1788845974.977808:0:6689:0:(genops.c:1385:class_connect()) connect: client 4592a189-21d8-449a-9335-07bfe0dc7877, cookie 0x1345bc80c773f4a1 00002000:00100000:2.0:1788845974.977820:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4592a189-21d8-449a-9335-07bfe0dc7877/ffff9a0c3d38f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788845974.977842:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788845974.978076:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788845974.978108:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d38c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845974.978299:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2350:x1875740720142720:12345-192.168.206.48@tcp:8:lhsmtool_posix.0 Request processed in 567us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845974.978308:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:3.0:1788845974.984490:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845974.984663:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720142848 00000100:00100000:0.0:1788845974.984672:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720142848 00000100:00100000:0.0:1788845974.984739:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:0.0:1788845974.984749:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+6:0:x1875740720142848:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788845974.985752:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788845975.031854:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1788845975.031887:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4592a189-21d8-449a-9335-07bfe0dc7877 00000100:00100000:3.0:1788845975.032185:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:0:x1875740720142848:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 47432us (47697us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788845975.032196:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:1.0:1788845975.038202:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845975.038562:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720143104 00000100:00100000:0.0:1788845975.038571:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720143104 00000100:00100000:0.0:1788845975.038757:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:0.0:1788845975.038768:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+56:10441:x1875740720143104:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00080000:3.0:1788845975.039059:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845975.039924:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+57:10441:x1875740720143104:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 1153us (1767us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788845975.039934:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:1.0:1788845975.044100:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845975.044388:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720143360 00000100:00100000:0.0:1788845975.044400:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720143360 00000100:00100000:0.0:1788845975.044465:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:0.0:1788845975.044476:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+57:10441:x1875740720143360:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788845975.045033:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+57:10441:x1875740720143360:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 549us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845975.045042:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:0.0:1788845975.050843:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845975.050987:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720143488 00000100:00100000:2.0:1788845975.050996:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720143488 00000100:00100000:2.0:1788845975.051058:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:2.0:1788845975.051068:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+57:10441:x1875740720143488:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845975.051087:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845975.051106:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f4a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cddd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.051188:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f4af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.051202:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.051212:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845975.051244:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845975.051278:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f4af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.051302:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f4a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cddd expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.051320:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f4af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cddd expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.051328:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845975.051331:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788845975.051334:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030600, rc 0) 00000100:00100000:2.0:1788845975.051389:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+58:10441:x1875740720143488:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 323us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845975.051396:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:2.0:1788845975.055402:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845975.055492:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720143616 00000100:00100000:0.0:1788845975.055503:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720143616 00000100:00100000:0.0:1788845975.055557:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:0.0:1788845975.055578:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4592a189-21d8-449a-9335-07bfe0dc7877+5:2354:x1875740720143616:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845975.055600:0:11681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845975.055621:0:11681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c773f4b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cde4 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788845975.055647:0:11681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9f96, blocks: 0x1 00010000:00010000:0.0:1788845975.055675:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788845975.055680:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845975.055689:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c773f4b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cde4 expref: 6 pid: 11681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.055707:0:11681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c773f4b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cde4 expref: 6 pid: 11681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.055720:0:11681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcf400, rc 0) 00000100:00100000:0.0:1788845975.055785:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4592a189-21d8-449a-9335-07bfe0dc7877+6:2354:x1875740720143616:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 219us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845975.055793:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:1.0:1788845975.062106:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845975.062190:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720143872 00000100:00100000:0.0:1788845975.062199:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720143872 00000100:00100000:0.0:1788845975.062257:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:0.0:1788845975.062267:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+58:10441:x1875740720143872:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788845975.062369:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+58:10441:x1875740720143872:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 103us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845975.062377:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:1.0:1788845975.066292:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845975.066390:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720144000 00000100:00100000:2.0:1788845975.066399:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720144000 00000100:00100000:2.0:1788845975.066488:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:2.0:1788845975.066499:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:10441:x1875740720144000:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845975.066515:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845975.066537:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035ba4f1a/0x1345bc80c773f4bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cdeb expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.066568:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c773f4b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cde4 expref: 7 pid: 11681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.066577:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845975.066593:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845975.066599:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035ba4f1a/0x1345bc80c773f4bd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdeb expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.066634:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c773f4b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cde4 expref: 7 pid: 11681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.066648:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c773f4b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cde4 expref: 7 pid: 11681 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845975.066672:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d664380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1875740739037056:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845975.066808:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c263e5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788845975.069137:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d664380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1875740739037056:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845975.069200:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035ba4f1a/0x1345bc80c773f4bd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdeb expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.069225:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02824c00, rc 0) 00000100:00100000:2.0:1788845975.069269:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+7:10441:x1875740720144000:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 2769us (2987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845975.069277:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:3.0:1788845975.070188:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845975.070346:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720144128 00000100:00100000:0.0:1788845975.070354:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720144128 00010000:00010000:0.0:1788845975.070388:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c773f4b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cde4 expref: 7 pid: 11681 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845975.070425:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:0.0:1788845975.070434:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26394850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+7:2354:x1875740720144128:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845975.070448:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845975.070479:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c773f4b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cde4 expref: 7 pid: 11681 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.070508:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c773f4b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cde4 expref: 7 pid: 11681 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.070530:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c773f4b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cde4 expref: 7 pid: 11681 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.070543:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845975.070547:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845975.070567:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035ba4f1a/0x1345bc80c773f4bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdeb expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.070577:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035ba4f1a/0x1345bc80c773f4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdeb expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.070911:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000035ba4f1a/0x1345bc80c773f4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdeb expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845975.070927:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1875740739037184:192.168.206.48@tcp:105: 00000100:00100000:0.0:1788845975.071051:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c41752b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845975.078401:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1875740739037184:192.168.206.48@tcp:105: 00010000:00010000:0.0:1788845975.078427:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845975.078437:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845975.078600:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26394850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+6:2354:x1875740720144128:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 8166us (8444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845975.078609:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:1.0:1788845975.078875:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720144256 00000100:00100000:1.0:1788845975.078882:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720144256 00002000:00100000:1.0:1788845975.078922:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a0c3537ea00 x1875740720144256/t0(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:326/0 lens 504/0 e 0 to 0 dl 1788845986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788845975.078950:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3537ea00 with x1875740720144256 ext(0->8) 00002000:00010000:1.0:1788845975.078965:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c3537ea00 00000100:00100000:1.0:1788845975.078996:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1788845975.079006:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720144256:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788845975.079965:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:2353:x1875740720144256:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 Request processed in 957us (1523us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788845975.079975:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00002000:00100000:1.0:1788845975.079983:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a0c3537ea00 x1875740720144256/t4294967302(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:326/0 lens 504/448 e 0 to 0 dl 1788845986 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788845975.079992:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3537ea00 with x1875740720144256 ext(0->8) 00002000:00010000:1.0:1788845975.079996:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c3537ea00 00000100:00100000:2.0:1788845975.082794:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845975.082897:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720144384 00000100:00100000:0.0:1788845975.082906:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720144384 00000100:00100000:0.0:1788845975.082997:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:0.0:1788845975.083008:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+58:10441:x1875740720144384:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788845975.118550:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1788845975.118568:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788845975.118615:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a0c06b2f000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788845975.118621:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c07762700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c06b2fc00 00000020:00080000:0.0:1788845975.118624:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c07762f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c1a1a4800 00000004:00080000:0.0:1788845975.118670:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1788845975.118687:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788845975.118731:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+13:10441:x1875740720144384:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 35721us (35940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845975.118740:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 80 00000020:00080000:0.0:1788845975.118806:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788845975.118905:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788845975.118981:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739037312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788845975.119346:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845975.119426:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845975.119433:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739037440:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788845975.119475:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845975.119872:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739037312 00000100:00100000:3.0:1788845975.119879:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739037312 00000100:00100000:1.0:1788845975.119918:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739037440 00000100:00100000:1.0:1788845975.119922:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739037440 00000100:00100000:1.0:1788845975.120186:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788845975.120196:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3309:x1875740739037440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788845975.120226:0:11681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788845975.120262:0:11681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f9f93, atime: 0x6a9f9f94, ctime: 0x6a9f9f93, blocks: 0x1 00010000:00010000:1.0:1788845975.120270:0:11681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c773f4c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.120288:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=307s v=(0 0) 00010000:00010000:1.0:1788845975.120292:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845975.120298:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c773f4c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.120332:0:11681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c773f4c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.120343:0:11681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c773f4c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.120350:0:11681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c773f4c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.120368:0:11681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788845975.121266:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3309:x1875740739037440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1068us (1787us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788845975.121276:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788845975.121393:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788845975.121403:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739037312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788845975.121876:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788845975.121881:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788845974 00002000:00010000:3.0:1788845975.121883:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788845975.121885:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788845974 -> 1788845974 00002000:00010000:3.0:1788845975.121887:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788845975.121924:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875740739037312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 523us (2864us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788845975.121931:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788845975.122062:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845975.122141:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720144512 00000100:00100000:2.0:1788845975.122148:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720144512 00000100:00100000:2.0:1788845975.122222:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:2.0:1788845975.122230:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+8:2354:x1875740720144512:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1788845975.122784:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788845975.122789:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788845975.122800:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845975.122808:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c773f4c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.122820:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01a00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788845975.122825:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c773f4c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.122834:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c773f4c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.122855:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c773f4c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.122863:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c773f4c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.122896:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845975.122898:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845975.122900:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788845975.123753:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a0c3cf3e680/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788845975.123764:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739037440:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788845975.123784:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a0c3cf3c700/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788845975.123789:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739037312:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1788845975.159579:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1788845975.159683:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1788845975.159796:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2354:x1875740720144512:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 37560us (37730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845975.159808:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:2.0:1788845975.161930:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845975.162422:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720144768 00000100:00100000:0.0:1788845975.162432:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720144768 00000100:00100000:0.0:1788845975.162479:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:0.0:1788845975.162488:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+13:10441:x1875740720144768:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788845975.162537:0:7134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845975.162563:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f4af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cddd expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.162642:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:0.0:1788845975.162646:0:7134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845975.162672:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f4cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.162685:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f4cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.162695:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f4cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788845975.162932:0:7134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000a7b4d8 reply state 0000000076e470ae transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f4cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845975.162941:0:7134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845975.163103:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+14:10441:x1875740720144768:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 614us (1179us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788845975.163120:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 81 00010000:00010000:0.0:1788845975.167774:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f4cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.167791:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f4cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.167799:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f4cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.167805:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845975.167810:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f4cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.167818:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f4cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.167836:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:0.0:1788845975.167839:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845975.167844:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f4cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.167851:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f4cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845975.169074:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845975.169242:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720144896 00000100:00100000:3.0:1788845975.169252:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720144896 00000100:00100000:3.0:1788845975.169337:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:3.0:1788845975.169353:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720144896:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788845975.170829:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788845975.170833:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788845974 -> 1788845973 00002000:00010000:3.0:1788845975.170835:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788845972 00002000:00010000:3.0:1788845975.170838:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788845974 -> 1788845973 00002000:00010000:3.0:1788845975.170840:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788845975.170934:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+7:2353:x1875740720144896:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 1572us (1857us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788845975.170944:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:3.0:1788845975.173623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845975.174350:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720145152 00000100:00100000:0.0:1788845975.174657:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720145152 00000100:00100000:0.0:1788845975.174768:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:0.0:1788845975.174779:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+13:10441:x1875740720145152:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788845975.174842:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.174858:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f48c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdcf expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.174867:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.174900:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f48c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdcf expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.174913:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f48c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdcf expref: 13 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845975.174927:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739037568:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845975.175020:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c417520c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845975.181219:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845975.181222:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739037568:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845975.181248:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845975.181311:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720145280 00000100:00100000:0.0:1788845975.181319:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720145280 00010000:00010000:0.0:1788845975.181353:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f48c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdcf expref: 14 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845975.181480:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:0.0:1788845975.181514:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+14:2354:x1875740720145280:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845975.181530:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845975.181536:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f48c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdcf expref: 14 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.181547:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f48c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdcf expref: 14 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.181567:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f48c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdcf expref: 14 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.181582:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:0.0:1788845975.181587:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.181596:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.181604:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.181633:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845975.181684:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+13:2354:x1875740720145280:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 171us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845975.181691:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00010000:00010000:1.0:1788845975.181744:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.181752:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.181777:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.181784:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.181800:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.181815:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845975.181818:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.181825:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.181834:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:1.0:1788845975.181836:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788845975.181839:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.181844:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f4d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845975.181881:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+12:10441:x1875740720145152:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 Request processed in 7104us (8266us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788845975.181888:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:3.0:1788845975.184235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845975.185014:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720145408 00000100:00100000:2.0:1788845975.185023:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720145408 00000100:00100000:2.0:1788845975.185089:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:2.0:1788845975.185099:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+7:2351:x1875740720145408:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788845975.185139:0:8094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.185234:0:8094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035ba4f1a/0x1345bc80c773f4bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdeb expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.185244:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845975.185248:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788845975.185253:0:8094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.185288:0:8094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035ba4f1a/0x1345bc80c773f4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdeb expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.185301:0:8094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035ba4f1a/0x1345bc80c773f4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdeb expref: 7 pid: 6689 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845975.185315:0:8094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d667480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8094:1875740739037696:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845975.185580:0:8094:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c263e5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788845975.188733:0:8094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d667480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8094:1875740739037696:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845975.188733:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:3.0:1788845975.188759:0:8094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845975.188811:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720145536 00000100:00100000:1.0:1788845975.188819:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720145536 00010000:00010000:1.0:1788845975.188851:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035ba4f1a/0x1345bc80c773f4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdeb expref: 8 pid: 6689 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845975.188890:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:1.0:1788845975.188899:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+8:2353:x1875740720145536:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845975.188912:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845975.188932:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035ba4f1a/0x1345bc80c773f4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdeb expref: 8 pid: 6689 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.188964:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035ba4f1a/0x1345bc80c773f4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdeb expref: 8 pid: 6689 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.188989:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035ba4f1a/0x1345bc80c773f4bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdeb expref: 8 pid: 6689 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.189004:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788845975.189008:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788845975.189013:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.189045:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.189081:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845975.189797:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d664700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+7:2353:x1875740720145536:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 895us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845975.189806:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00010000:00010000:3.0:1788845975.189909:0:8094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845975.189919:0:8094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845975.189946:0:8094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845975.189962:0:8094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845975.189970:0:8094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845975.189977:0:8094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788845975.189981:0:8094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845975.189990:0:8094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845975.190005:0:8094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845975.190013:0:8094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e44e5902/0x1345bc80c773f4d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845975.190095:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2351:x1875740720145408:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 4997us (5867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845975.190103:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:2.0:1788845975.193118:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845975.193530:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720145792 00000100:00100000:1.0:1788845975.193539:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720145792 00000100:00100000:1.0:1788845975.193691:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:1.0:1788845975.193702:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+12:10441:x1875740720145792:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788845975.193779:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f4e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.193796:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.193822:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.194017:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.194040:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f49a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdd6 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.194048:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.194339:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f49a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdd6 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.194354:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f49a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdd6 expref: 13 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845975.194367:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3ebdc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875740739037824:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788845975.194476:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c109aae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845975.196845:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845975.196912:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720145920 00000100:00100000:3.0:1788845975.196919:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720145920 00010000:00010000:3.0:1788845975.196952:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f49a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdd6 expref: 14 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845975.196998:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:3.0:1788845975.197006:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+14:2353:x1875740720145920:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845975.197018:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845975.197037:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f49a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdd6 expref: 14 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845975.197050:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f49a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdd6 expref: 14 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845975.197076:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:3.0:1788845975.197081:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845975.197090:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845975.197097:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845975.197123:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845975.197188:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+14:2353:x1875740720145920:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 182us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845975.197195:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00010000:00010000:0.0:1788845975.197406:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f49a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdd6 expref: 13 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845975.197422:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3ebdc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875740739037824:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788845975.197449:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.197457:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.197462:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845975.197622:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788845975.197757:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788845975.197799:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788845975.197869:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875740739037952:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788845975.197913:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845975.198106:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c41752000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845975.199366:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739037952 00000100:00100000:1.0:1788845975.199375:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739037952 00000100:00100000:1.0:1788845975.199458:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845975.199468:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875740739037952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788845975.199563:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875740739037952:12345-0@lo:1000:mdt00_000.0 Request processed in 97us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845975.199581:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845975.199659:0:5845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788845975.199665:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a0c3cf3c700, transno 4294967303 00000100:00100000:2.0:1788845975.199686:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875740739037952:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788845975.200256:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788845975.200326:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875740739038080:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788845975.200376:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845975.200855:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c263e5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788845975.200901:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739038080 00000100:00100000:0.0:1788845975.200907:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739038080 00000100:00100000:0.0:1788845975.200941:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788845975.200949:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875740739038080:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788845975.201218:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875740739038080:12345-0@lo:1000:mdt00_000.0 Request processed in 269us (841us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788845975.201226:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788845975.201257:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d666d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875740739038080:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788845975.201292:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201301:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201309:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201314:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845975.201318:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201325:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201338:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845975.201341:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788845975.201354:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201360:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f4e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201395:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f415 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201401:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f415 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201407:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f415 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201412:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845975.201415:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f415 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201421:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f415 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201429:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fe00) 00010000:00010000:2.0:1788845975.201432:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788845975.201434:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f415 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201440:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f415 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201460:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201473:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f431 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdba expref: 16 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201490:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201517:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdba expref: 16 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.201530:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f431 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdba expref: 16 pid: 7134 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845975.201542:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26327800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875740739038208:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845975.201739:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c263e5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788845975.204250:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845975.204463:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720146048 00000100:00100000:0.0:1788845975.204471:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720146048 00000100:00100000:2.0:1788845975.204534:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26327800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875740739038208:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845975.204559:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.205481:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f431 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdba expref: 17 pid: 7134 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845975.205585:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:0.0:1788845975.205598:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+17:2353:x1875740720146048:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845975.205623:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845975.205631:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f431 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdba expref: 17 pid: 7134 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.205643:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdba expref: 17 pid: 7134 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.205664:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f431 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdba expref: 17 pid: 7134 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.205680:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fe00) 00010000:00010000:0.0:1788845975.205685:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.205694:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845975.205701:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.205785:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845975.205845:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+16:2353:x1875740720146048:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 251us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845975.205853:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00010000:00010000:0.0:1788845975.206308:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845975.206673:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206682:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206693:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206699:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206706:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206722:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845975.206727:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206734:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206745:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fe00) 00010000:00010000:2.0:1788845975.206748:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845975.206752:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206758:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f4ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206769:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206776:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f4e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206781:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f4e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206786:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845975.206788:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f4e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206793:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f4e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206811:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fe00) 00010000:00010000:2.0:1788845975.206813:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788845975.206816:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f4e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.206821:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f4e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845975.207042:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+15:10441:x1875740720145792:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 13340us (13931us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788845975.207051:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 83 00000020:00080000:2.0:1788845975.207548:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788845975.207813:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845975.207818:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845975.207845:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788845975.207851:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788845975.210034:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845975.210108:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720146304 00000100:00100000:2.0:1788845975.210126:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720146304 00000100:00100000:2.0:1788845975.210200:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:2.0:1788845975.210211:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+15:10441:x1875740720146304:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788845975.210856:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788845975.210962:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788845975.211006:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f4f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.211022:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f4f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.211046:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f4f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.211054:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f4f5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.211072:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f4f5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.211079:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f4f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845975.211098:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788845975.211209:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+17:10441:x1875740720146304:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 999us (1192us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788845975.211217:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000020:00080000:2.0:1788845975.211221:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788845975.211969:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845975.211977:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f4f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.211985:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788845975.211989:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f4f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.211998:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f4f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.212013:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a0c04c4fa00) 00010000:00010000:1.0:1788845975.212016:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788845975.212021:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f4f5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.212038:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f4f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845975.212056:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845975.212058:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845975.212060:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845976.230551:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788845976.597391:0:12046:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788845976.597401:0:12046:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788845976.597435:0:12046:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788845976.597441:0:12046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788845976.709887:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845976.710136:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720146560 00000100:00100000:2.0:1788845976.710148:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720146560 00000100:00100000:2.0:1788845976.710225:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:2.0:1788845976.710235:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+17:10458:x1875740720146560:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845976.710257:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845976.710276:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f4fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cdf2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.710366:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f503 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.710380:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f503 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.710401:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f503 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845976.710414:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788845976.710537:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f4fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdf2 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.710556:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f503 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdf2 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.710564:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:2.0:1788845976.710567:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788845976.710570:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02824000, rc 0) 00000100:00100000:2.0:1788845976.710638:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+19:10458:x1875740720146560:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 404us (760us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788845976.710646:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:3.0:1788845976.716043:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845976.716114:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720146688 00000100:00100000:1.0:1788845976.716124:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720146688 00000100:00100000:1.0:1788845976.716219:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:1.0:1788845976.716229:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+19:10458:x1875740720146688:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:1.0:1788845976.716306:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f511 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716323:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716334:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716349:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f518 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716356:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716363:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716585:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f51f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716593:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f51f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716601:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f51f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845976.716635:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f51f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716646:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716663:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f511 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716669:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f511 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716676:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845976.716679:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f511 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716700:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f511 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716711:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:1.0:1788845976.716714:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845976.716718:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f511 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716724:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f511 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716735:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716739:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f518 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716744:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716748:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845976.716756:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716762:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f518 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716781:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c10382100) 00010000:00010000:1.0:1788845976.716784:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845976.716786:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f518 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716793:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f518 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716806:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f51f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716812:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f51f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716817:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f51f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716821:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845976.716824:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f51f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716829:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f51f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716836:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c10382300) 00010000:00010000:1.0:1788845976.716838:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845976.716847:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f51f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.716853:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f51f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845976.716922:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+19:10458:x1875740720146688:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 694us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845976.716930:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:3.0:1788845976.765052:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845976.765187:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720146944 00000100:00100000:2.0:1788845976.765198:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720146944 00000100:00100000:2.0:1788845976.765257:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:2.0:1788845976.765267:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+19:10461:x1875740720146944:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845976.765287:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845976.765307:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f526 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cdf9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765371:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f52d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765393:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f52d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765403:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f52d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765417:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f534 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765422:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765428:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765675:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f53b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765693:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f53b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765700:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f53b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845976.765709:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788845976.765788:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f52d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765796:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f52d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765803:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f52d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765815:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845976.765820:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f52d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765827:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f52d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765839:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:2.0:1788845976.765842:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845976.765847:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f52d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765853:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773f52d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765864:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765869:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f534 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765874:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765879:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845976.765882:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765887:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f534 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765905:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c04c4fe00) 00010000:00010000:2.0:1788845976.765908:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845976.765911:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f534 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765916:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773f534 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765956:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773f526 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdf9 expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765969:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f53b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdf9 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.765976:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845976.765978:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845976.765980:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030e00, rc 0) 00000100:00100000:2.0:1788845976.766050:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+21:10461:x1875740720146944:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 784us (1008us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788845976.766058:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:1.0:1788845976.770697:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845976.770731:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720147072 00000100:00100000:1.0:1788845976.770740:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720147072 00000100:00100000:1.0:1788845976.770815:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:1.0:1788845976.770825:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+21:10461:x1875740720147072:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:1.0:1788845976.770887:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f549 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.770905:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.770917:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.770941:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.770948:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f549 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.770954:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.770970:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845976.770975:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.770995:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f549 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.771008:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:1.0:1788845976.771011:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788845976.771026:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f549 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845976.771033:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f549 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845976.771094:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+21:10461:x1875740720147072:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 269us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845976.771102:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:1.0:1788845976.778036:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845976.778128:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720147328 00000100:00100000:2.0:1788845976.778138:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720147328 00000100:00100000:2.0:1788845976.778243:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:2.0:1788845976.778253:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08dc3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+21:10461:x1875740720147328:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788845976.778475:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08dc3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+22:10461:x1875740720147328:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 213us (451us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788845976.778593:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:1.0:1788845976.828861:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845976.829262:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720147584 00000100:00100000:2.0:1788845976.829272:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720147584 00000100:00100000:2.0:1788845976.829333:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:2.0:1788845976.829343:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+22:9982:x1875740720147584:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788845976.829368:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845976.829388:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f550 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce00 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.829553:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.829569:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f53b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdf9 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.829577:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.829609:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f53b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdf9 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.829622:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f53b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdf9 expref: 23 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845976.829634:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26327800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739038336:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845976.829840:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c263e5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845976.833755:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26327800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739038336:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845976.833922:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845976.836521:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845976.836816:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720147712 00000100:00100000:3.0:1788845976.836825:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720147712 00010000:00010000:3.0:1788845976.836862:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f53b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdf9 expref: 24 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845976.836901:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:3.0:1788845976.836911:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+24:2354:x1875740720147712:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845976.836924:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845976.836932:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f53b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdf9 expref: 24 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.836944:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f53b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdf9 expref: 24 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.836968:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f53b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdf9 expref: 24 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.836985:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:3.0:1788845976.836990:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.836999:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.837006:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.837046:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845976.837110:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+23:2354:x1875740720147712:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 200us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845976.837130:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00010000:00010000:2.0:1788845976.837819:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.837829:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845976.837846:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788845976.837986:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f550 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce00 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.838003:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce00 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.838011:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845976.838014:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788845976.838026:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030c00, rc 0) 00000100:00100000:2.0:1788845976.838078:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+23:9982:x1875740720147584:12345-192.168.206.48@tcp:101:bash.0 Request processed in 8736us (9224us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788845976.838085:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:1.0:1788845976.841907:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845976.841984:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720147968 00000100:00100000:2.0:1788845976.841993:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720147968 00000100:00100000:2.0:1788845976.842057:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00100000:2.0:1788845976.842067:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+23:9982:x1875740720147968:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:2.0:1788845976.842348:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f565 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.842365:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f565 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.842386:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f565 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845976.842437:0:7134:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788845976.842466:0:7134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5526dbb reply state 00000000dfc97cab transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f565 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845976.842475:0:7134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788845976.842522:0:7134:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788845976.842628:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+27:9982:x1875740720147968:12345-192.168.206.48@tcp:36:bash.0 Request processed in 562us (728us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788845976.842636:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 89 00000020:00080000:2.0:1788845976.842640:0:7134:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788845976.844987:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f565 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.845002:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f565 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.845009:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f565 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.845014:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845976.845029:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f565 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.845037:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f565 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.845052:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:3.0:1788845976.845055:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845976.845060:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f565 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.845065:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f565 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845976.845537:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845976.845839:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720148096 00000100:00100000:3.0:1788845976.845847:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720148096 00000100:00100000:3.0:1788845976.845897:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:3.0:1788845976.845907:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+26:9982:x1875740720148096:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1788845976.845928:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845976.845958:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f56c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce07 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.846011:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f56c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce07 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.846036:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f56c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce07 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.846056:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:3.0:1788845976.846059:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845976.846061:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474000, rc 0) 00000100:00100000:3.0:1788845976.846256:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+27:9982:x1875740720148096:12345-192.168.206.48@tcp:101:bash.0 Request processed in 348us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845976.846262:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:1.0:1788845976.849086:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845976.849324:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720148224 00000100:00100000:3.0:1788845976.849334:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720148224 00000100:00100000:3.0:1788845976.849447:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:3.0:1788845976.849458:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:9982:x1875740720148224:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1788845976.849475:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845976.849504:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773f573 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce0e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845976.849529:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f9f95, atime: 0x6a9f9f94, ctime: 0x6a9f9f95, blocks: 0xb 00010000:00010000:3.0:1788845976.849548:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=309s v=(0 0) 00010000:00010000:3.0:1788845976.849553:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845976.849570:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773f573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce0e expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.849603:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773f573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce0e expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.849615:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475800, rc 0) 00000100:00100000:3.0:1788845976.849671:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+7:9982:x1875740720148224:12345-192.168.206.48@tcp:101:bash.0 Request processed in 216us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845976.849678:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00080000:0.0:1788845976.850454:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845976.852217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845976.852331:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720148352 00000100:00100000:2.0:1788845976.852341:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720148352 00002000:00010000:2.0:1788845976.852375:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788845976.852380:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3ebdc000 with x1875740720148352 ext(0->18446744073709551615) 00002000:00010000:2.0:1788845976.852390:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c3ebdc000. 00000100:00100000:2.0:1788845976.852422:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:2.0:1788845976.852431:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4592a189-21d8-449a-9335-07bfe0dc7877+7:2353:x1875740720148352:12345-192.168.206.48@tcp:10:bash.0 00002000:00010000:2.0:1788845976.852824:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788845976.852828:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788845973 -> 1788845976 00002000:00010000:2.0:1788845976.852830:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788845972 -> 1788845972 00002000:00010000:2.0:1788845976.852832:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788845973 -> 1788845976 00002000:00010000:2.0:1788845976.852834:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788845976.853041:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4592a189-21d8-449a-9335-07bfe0dc7877+8:2353:x1875740720148352:12345-192.168.206.48@tcp:10:bash.0 Request processed in 610us (832us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788845976.853066:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00002000:00010000:2.0:1788845976.853069:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788845976.853072:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3ebdc000 with x1875740720148352 ext(0->18446744073709551615) 00002000:00010000:2.0:1788845976.853078:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c3ebdc000. 00000100:00100000:0.0:1788845976.930373:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845976.930473:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720148480 00000100:00100000:2.0:1788845976.930546:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720148480 00000100:00100000:2.0:1788845976.930637:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:2.0:1788845976.930647:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+27:10475:x1875740720148480:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:2.0:1788845976.930783:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f57a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.930907:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f57a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.930919:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f57a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.930934:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.930940:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.930946:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931293:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f588 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931302:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931315:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845976.931351:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931361:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f57a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931368:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f57a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931374:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f57a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931380:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845976.931385:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f57a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931392:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f57a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931404:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:2.0:1788845976.931407:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845976.931411:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f57a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931417:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f57a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931429:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931440:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f581 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931446:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931450:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845976.931454:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931460:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f581 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931468:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c04c4fe00) 00010000:00010000:2.0:1788845976.931470:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845976.931472:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f581 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.931676:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f581 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.933568:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.933578:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f588 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.933585:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.933590:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845976.933609:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.933616:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f588 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.933631:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845976.933634:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845976.933638:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f588 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.933645:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f588 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845976.933756:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+27:10475:x1875740720148480:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 3106us (3387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845976.933774:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:1.0:1788845976.973131:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845976.973339:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720148736 00000100:00100000:2.0:1788845976.973350:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720148736 00000100:00100000:2.0:1788845976.973416:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 92 00000100:00100000:2.0:1788845976.973427:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+27:10478:x1875740720148736:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845976.973448:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845976.973468:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f58f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce15 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.973546:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f596 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.973562:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.973585:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.973600:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f59d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.973607:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.973613:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.973868:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f5a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.973877:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.973885:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845976.973895:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788845976.973984:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.973991:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f596 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.973997:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f596 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974004:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845976.974013:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f596 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974031:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f596 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974043:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:2.0:1788845976.974046:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845976.974051:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f596 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974057:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f596 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974069:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974076:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f59d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974082:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f59d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974087:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845976.974090:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f59d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974095:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f59d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974102:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c04c4fe00) 00010000:00010000:2.0:1788845976.974104:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845976.974113:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f59d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974118:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f59d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974206:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f58f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce15 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974220:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce15 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.974226:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845976.974229:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788845976.974231:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00031000, rc 0) 00000100:00100000:2.0:1788845976.974294:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+29:10478:x1875740720148736:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 869us (1171us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788845976.974302:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 92 00000100:00100000:1.0:1788845976.983947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845976.984048:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720148864 00000100:00100000:3.0:1788845976.984058:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720148864 00000100:00100000:3.0:1788845976.984114:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:3.0:1788845976.984125:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+29:10478:x1875740720148864:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:3.0:1788845976.984220:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.984249:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce00 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.984260:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.984295:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce00 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.984308:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce00 expref: 29 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845976.984338:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875740739038464:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845976.984428:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1905c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788845976.986850:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875740739038464:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845976.986877:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845976.987185:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845976.987923:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720149120 00000100:00100000:0.0:1788845976.987942:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720149120 00000100:00100000:0.0:1788845976.988001:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:0.0:1788845976.988316:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+30:5588:x1875740720149120:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788845976.988831:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+31:5588:x1875740720149120:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 819us (1673us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788845976.988840:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:1.0:1788845976.993720:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845976.993892:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720149248 00000100:00100000:3.0:1788845976.993902:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720149248 00010000:00010000:3.0:1788845976.993941:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce00 expref: 31 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845976.994041:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:3.0:1788845976.994052:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+31:2353:x1875740720149248:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845976.994067:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845976.994074:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce00 expref: 31 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.994087:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce00 expref: 31 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.994108:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f557 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce00 expref: 31 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.994123:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:3.0:1788845976.994128:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.994150:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.994248:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845976.994287:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845976.994338:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+30:2353:x1875740720149248:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 287us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845976.994346:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00010000:00010000:2.0:1788845976.994359:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.994371:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.994398:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.994404:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.994411:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.994423:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845976.994427:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.994435:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.994444:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845976.994447:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845976.994450:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845976.994457:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845976.994500:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+29:10478:x1875740720148864:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 10376us (10563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845976.994508:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:1.0:1788845976.996758:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845976.996845:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720149504 00000100:00100000:2.0:1788845976.996855:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720149504 00000100:00100000:2.0:1788845976.996916:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:2.0:1788845976.996927:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+29:10478:x1875740720149504:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788845976.997184:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+30:10478:x1875740720149504:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 258us (432us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788845976.997192:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1788845976.998331:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845976.998350:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c26327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739038592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845976.998401:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845976.999539:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739038592 00000100:00100000:2.0:1788845976.999550:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739038592 00000100:00100000:2.0:1788845976.999596:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788845976.999617:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875740739038592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845976.999656:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845976.999724:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875740739038592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845976.999732:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788845976.999816:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c26327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739038592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845977.111490:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.111712:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720149760 00000100:00100000:0.0:1788845977.111722:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720149760 00000100:00100000:0.0:1788845977.111813:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00100000:0.0:1788845977.111824:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+30:10489:x1875740720149760:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:0.0:1788845977.111855:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845977.111874:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f5b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce1c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.111944:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f5c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.111960:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f5c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.111970:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f5c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.111983:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f5c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.111989:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.111995:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112274:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f5ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112283:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112289:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845977.112298:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788845977.112377:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f5c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112385:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f5c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112391:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f5c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112397:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845977.112401:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f5c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112408:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f5c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112420:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:0.0:1788845977.112423:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845977.112427:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f5c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112444:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f5c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112456:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112461:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f5c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112483:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112611:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845977.112615:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112621:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f5c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112630:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c11677400) 00010000:00010000:0.0:1788845977.112632:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845977.112635:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f5c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112641:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f5c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112681:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f5b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce1c expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112694:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f5ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce1c expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.112707:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:0.0:1788845977.112709:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845977.112712:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcee00, rc 0) 00000100:00100000:0.0:1788845977.112771:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+32:10489:x1875740720149760:12345-192.168.206.48@tcp:101:cat.0 Request processed in 949us (1290us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788845977.112779:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00080000:3.0:1788845977.113001:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845977.117901:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845977.117992:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720150016 00000100:00100000:2.0:1788845977.118002:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720150016 00000100:00100000:2.0:1788845977.118075:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:2.0:1788845977.118085:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+32:10489:x1875740720150016:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:2.0:1788845977.118346:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+33:10489:x1875740720150016:12345-192.168.206.48@tcp:35:cat.0 Request processed in 262us (454us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788845977.118354:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:1.0:1788845977.138513:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845977.138622:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720150272 00000100:00100000:2.0:1788845977.138633:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720150272 00000100:00100000:2.0:1788845977.138751:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 95 00000100:00100000:2.0:1788845977.138762:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+33:10490:x1875740720150272:12345-192.168.206.48@tcp:36:rm.0 00010000:00010000:2.0:1788845977.138822:0:7134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788845977.138852:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f5ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce1c expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.138874:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f5a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce15 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.138888:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f56c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce07 expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.138918:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845977.138928:0:7134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845977.138947:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f5dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.138959:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f5dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.138968:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f5dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.138982:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f5e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.138989:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f5e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.138996:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f5e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.140395:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f5ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.140410:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f5ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.140420:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f5ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788845977.140998:0:7134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788845977.143519:0:7134:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 309360363345ns, next at 310357851759ns, rc = 0 00010000:00010000:2.0:1788845977.143646:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f5f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143662:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f5f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143673:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f5f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143681:0:7134:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f5f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143688:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f5f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143694:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f5f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143722:0:7134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788845977.143744:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f5ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143751:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f5ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143757:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f5ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143763:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845977.143767:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f5ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143773:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f5ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143793:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4ff00) 00010000:00010000:2.0:1788845977.143796:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788845977.143801:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f5ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143806:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f5ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143825:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f5dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143832:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f5dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143838:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f5dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143843:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845977.143845:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f5dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143851:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f5dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143859:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:2.0:1788845977.143861:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845977.143864:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f5dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.143871:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f5dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845977.143893:0:7134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026301449 reply state 00000000b3d60828 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f5e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845977.143902:0:7134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788845977.144080:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845977.144087:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f5f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.144093:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030c00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788845977.144096:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f5f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.144102:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f5f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.144110:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a0c04c4ff00) 00010000:00010000:0.0:1788845977.144112:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788845977.144115:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f5f1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.144120:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f5f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.144134:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845977.144135:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845977.144137:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845977.144214:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+32:10490:x1875740720150272:12345-192.168.206.48@tcp:36:rm.0 Request processed in 5450us (5707us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788845977.144223:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 95 00010000:00010000:0.0:1788845977.147804:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f5e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.147834:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f5e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.147841:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f5e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.147847:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845977.147852:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f5e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.147860:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f5e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.147876:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c04c4fe00) 00010000:00010000:0.0:1788845977.147880:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845977.147884:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f5e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.147891:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f5e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845977.188144:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.188318:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720150528 00000100:00100000:3.0:1788845977.188328:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720150528 00000100:00100000:3.0:1788845977.188376:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 96 00000100:00100000:3.0:1788845977.188385:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+31:10496:x1875740720150528:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1788845977.188406:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845977.188425:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f5f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce23 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.188539:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.188554:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.188578:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.188592:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f606 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.188600:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.188607:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788845977.189126:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788845977.189306:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f60d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.189316:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f60d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.189324:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f60d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.189353:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.189359:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5ff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.189364:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.189370:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845977.189379:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.189386:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.189398:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:3.0:1788845977.189400:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845977.189404:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.189410:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f5ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845977.189421:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000509f47aa reply state 000000003f4c491a transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845977.189428:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788845977.189451:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f5f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce23 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.189462:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f60d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce23 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.189469:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164100) 00010000:00010000:3.0:1788845977.189471:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845977.189474:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474c00, rc 0) 00000100:00100000:3.0:1788845977.189541:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+34:10496:x1875740720150528:12345-192.168.206.48@tcp:101:bash.0 Request processed in 1156us (1405us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788845977.189549:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 96 00010000:00010000:3.0:1788845977.192809:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f606 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.192824:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f606 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.192831:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f606 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.192837:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845977.192842:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f606 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.192849:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f606 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.192865:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c31164d00) 00010000:00010000:3.0:1788845977.192868:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845977.192873:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f606 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.192879:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f606 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845977.195484:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.195557:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720150656 00000100:00100000:3.0:1788845977.195566:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720150656 00000100:00100000:3.0:1788845977.195637:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:3.0:1788845977.195648:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+7:2354:x1875740720150656:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1788845977.195665:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845977.195685:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004fdfc48/0x1345bc80c773f61b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce2a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845977.195726:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788845977.195744:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=309s v=(0 0) 00010000:00010000:3.0:1788845977.195749:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845977.195758:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004fdfc48/0x1345bc80c773f61b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce2a expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.195774:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004fdfc48/0x1345bc80c773f61b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce2a expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.195785:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475a00, rc 0) 00000100:00100000:3.0:1788845977.195845:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+8:2354:x1875740720150656:12345-192.168.206.48@tcp:101:bash.0 Request processed in 198us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845977.195852:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00080000:0.0:1788845977.195916:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845977.202552:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.202681:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720150784 00000100:00100000:3.0:1788845977.202691:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720150784 00000100:00100000:3.0:1788845977.202750:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:3.0:1788845977.202760:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+8:10496:x1875740720150784:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1788845977.202778:0:8094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845977.202795:0:8094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce31 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.202826:0:8094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004fdfc48/0x1345bc80c773f61b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce2a expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.202852:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845977.202857:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845977.202863:0:8094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 9 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.202898:0:8094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004fdfc48/0x1345bc80c773f61b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce2a expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.202912:0:8094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004fdfc48/0x1345bc80c773f61b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce2a expref: 9 pid: 6688 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845977.202927:0:8094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8094:1875740739038720:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845977.203037:0:8094:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1905c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788845977.208401:0:8094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8094:1875740739038720:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845977.208436:0:8094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 9 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.208457:0:8094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474200, rc 0) 00000100:00100000:3.0:1788845977.208563:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+9:10496:x1875740720150784:12345-192.168.206.48@tcp:101:bash.0 Request processed in 5803us (6017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845977.208573:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:2.0:1788845977.209232:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.209337:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720150912 00000100:00100000:3.0:1788845977.209344:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720150912 00010000:00010000:3.0:1788845977.209376:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004fdfc48/0x1345bc80c773f61b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce2a expref: 9 pid: 6688 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845977.209428:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:3.0:1788845977.209437:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c02d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+9:2354:x1875740720150912:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845977.209451:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845977.209472:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004fdfc48/0x1345bc80c773f61b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce2a expref: 9 pid: 6688 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.209485:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004fdfc48/0x1345bc80c773f61b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce2a expref: 9 pid: 6688 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.209507:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004fdfc48/0x1345bc80c773f61b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce2a expref: 9 pid: 6688 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.209521:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845977.209525:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845977.209533:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 8 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.209542:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 8 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.209577:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 8 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845977.209591:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5832:1875740739038848:192.168.206.48@tcp:105: 00000100:00100000:3.0:1788845977.209659:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1905c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788845977.214701:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5832:1875740739038848:192.168.206.48@tcp:105: 00010000:00010000:3.0:1788845977.214725:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845977.214780:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c02d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:2354:x1875740720150912:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 5343us (5550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845977.214794:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:2.0:1788845977.215537:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.215600:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720151168 00000100:00100000:0.0:1788845977.215608:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720151168 00000100:00100000:0.0:1788845977.215657:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:0.0:1788845977.215667:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+33:10496:x1875740720151168:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:0.0:1788845977.215970:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+34:10496:x1875740720151168:12345-192.168.206.48@tcp:35:bash.0 Request processed in 303us (434us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788845977.215977:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00010000:00010000:1.0:1788845977.254385:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788845977.256590:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788845977.256599:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788845977.256630:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788845977.256636:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788845977.356942:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.357043:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720151296 00000100:00100000:3.0:1788845977.357052:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720151296 00000100:00100000:3.0:1788845977.357107:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:3.0:1788845977.357117:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+34:10512:x1875740720151296:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845977.357140:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845977.357184:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f629 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce38 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.357246:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f630 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.357260:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.357271:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845977.357303:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788845977.357306:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845977.357322:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f630 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.357346:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce38 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.357378:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f630 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce38 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.357386:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:3.0:1788845977.357390:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788845977.357393:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474000, rc 0) 00000100:00100000:3.0:1788845977.357456:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+35:10512:x1875740720151296:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 340us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845977.357462:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:1.0:1788845977.360499:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.360580:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720151552 00000100:00100000:3.0:1788845977.360590:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720151552 00000100:00100000:3.0:1788845977.360646:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 98 00000100:00100000:3.0:1788845977.360656:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+35:10512:x1875740720151552:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845977.360674:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845977.360693:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f637 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce3f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.360781:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f63e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.360795:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f63e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.360805:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f63e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845977.360815:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788845977.360953:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f637 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce3f expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.360973:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f63e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce3f expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.360981:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164100) 00010000:00010000:3.0:1788845977.360984:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845977.360988:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f57200, rc 0) 00000100:00100000:3.0:1788845977.361058:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+37:10512:x1875740720151552:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 404us (566us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788845977.361065:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 98 00000100:00100000:1.0:1788845977.364305:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845977.364452:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720151936 00000100:00100000:2.0:1788845977.364461:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720151936 00000100:00100000:2.0:1788845977.364519:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1788845977.364529:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+37:2351:x1875740720151936:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845977.364542:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845977.364564:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f63e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce3f expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.364583:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164100) 00010000:00010000:2.0:1788845977.364588:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845977.364642:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+36:2351:x1875740720151936:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 114us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845977.364650:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1788845977.366756:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.366855:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720151808 00000100:00100000:3.0:1788845977.366864:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720151808 00000100:00100000:3.0:1788845977.366920:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:3.0:1788845977.366929:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+36:10512:x1875740720151808:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845977.366952:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845977.366972:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f64c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce46 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.367077:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f653 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.367091:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f653 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.367103:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f653 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845977.367132:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788845977.367355:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f64c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce46 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.367374:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f653 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce46 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.367383:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164100) 00010000:00010000:3.0:1788845977.367385:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788845977.367388:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f57600, rc 0) 00000100:00100000:3.0:1788845977.368091:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+38:10512:x1875740720151808:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1159us (1339us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788845977.368100:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:1.0:1788845977.381232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.382308:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720152064 00000100:00100000:3.0:1788845977.382319:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720152064 00000100:00100000:3.0:1788845977.382415:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:3.0:1788845977.382426:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+8:2353:x1875740720152064:12345-192.168.206.48@tcp:1:lfs.0 00010000:00010000:3.0:1788845977.382471:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.382492:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 8 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.382500:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845977.382504:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845977.382509:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.382552:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 8 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.382566:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 8 pid: 8094 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845977.382580:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1875740739038976:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845977.382835:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3c9739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845977.384924:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1875740739038976:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845977.384951:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845977.385862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.387410:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720152192 00000100:00100000:0.0:1788845977.387433:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720152192 00002000:00100000:0.0:1788845977.387485:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a0c3eb4fb80 x1875740720152192/t0(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:328/0 lens 504/0 e 0 to 0 dl 1788845988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788845977.387496:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3eb4fb80 with x1875740720152192 ext(0->8) 00010000:00010000:0.0:1788845977.387504:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 9 pid: 8094 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.387519:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 9 pid: 8094 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788845977.387527:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a0c3eb4fb80 00000100:00100000:0.0:1788845977.387616:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:0.0:1788845977.387627:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4592a189-21d8-449a-9335-07bfe0dc7877+9:2353:x1875740720152192:12345-192.168.206.48@tcp:4:lfs.0 00000100:00100000:0.0:1788845977.388050:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4592a189-21d8-449a-9335-07bfe0dc7877+11:2353:x1875740720152192:12345-192.168.206.48@tcp:4:lfs.0 Request processed in 424us (2191us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788845977.388058:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00002000:00100000:0.0:1788845977.388065:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a0c3eb4fb80 x1875740720152192/t4294967302(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:328/0 lens 504/448 e 0 to 0 dl 1788845988 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788845977.388072:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3eb4fb80 with x1875740720152192 ext(0->8) 00010000:00010000:0.0:1788845977.388078:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 11 pid: 8094 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.388090:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 11 pid: 8094 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788845977.388108:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a0c3eb4fb80 00000100:00100000:1.0:1788845977.397815:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.397933:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720152320 00000100:00100000:0.0:1788845977.397942:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720152320 00010000:00010000:0.0:1788845977.397974:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 11 pid: 8094 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845977.398011:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:0.0:1788845977.398030:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+11:2354:x1875740720152320:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845977.398043:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788845977.398061:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788845977.398064:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788845977 00002000:00010000:0.0:1788845977.398066:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788845977 00002000:00010000:0.0:1788845977.398069:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788845977 00010000:00010000:0.0:1788845977.398074:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 11 pid: 8094 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.398088:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 11 pid: 8094 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.398109:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bab8ea/0x1345bc80c773f622 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce31 expref: 11 pid: 8094 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.398124:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788845977.398128:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788845977.398134:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.398184:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.398222:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845977.398264:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+10:2354:x1875740720152320:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 235us (456us total) trans 0 rc 0/0 00010000:00010000:2.0:1788845977.398405:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.398415:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.398441:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.398449:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.398456:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.398463:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57200 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:2.0:1788845977.398467:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.398475:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.398486:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.398494:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b21b5d/0x1345bc80c773f661 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845977.398550:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+10:2353:x1875740720152064:12345-192.168.206.48@tcp:1:lfs.0 Request processed in 16125us (17325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845977.398558:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:0.0:1788845977.398608:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:2.0:1788845977.401322:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845977.401457:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720152576 00000100:00100000:1.0:1788845977.401466:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720152576 00000100:00100000:1.0:1788845977.401518:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:1.0:1788845977.401528:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+38:10512:x1875740720152576:12345-192.168.206.48@tcp:35:lfs.0 00000004:00010000:1.0:1788845977.401584:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f653 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce46 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788845977.401832:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788845977.401878:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788845977.402210:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788845977.402260:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.402410:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f60d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce23 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.402433:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.402465:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f60d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce23 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.402480:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f60d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce23 expref: 42 pid: 5847 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845977.402493:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb4dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1875740739039104:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788845977.402562:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c109aa180 going to sleep for 11 seconds 00000100:00100000:1.0:1788845977.405659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.405747:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720152704 00000100:00100000:3.0:1788845977.405756:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720152704 00010000:00010000:3.0:1788845977.405790:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f60d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce23 expref: 43 pid: 5847 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845977.405830:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:3.0:1788845977.405848:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+43:2353:x1875740720152704:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845977.405862:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845977.405869:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f60d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce23 expref: 43 pid: 5847 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.405882:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f60d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce23 expref: 43 pid: 5847 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.405915:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164100) 00010000:00010000:3.0:1788845977.405921:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.405930:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.405938:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.405955:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845977.406005:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+43:2353:x1875740720152704:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 158us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845977.406022:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00010000:00010000:2.0:1788845977.406371:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f60d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce23 expref: 42 pid: 5847 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845977.406386:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb4dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1875740739039104:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845977.406406:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.406414:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.406420:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845977.406525:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788845977.406700:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788845977.406816:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875740739039232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788845977.406872:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845977.406891:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c21a90840 going to sleep for 11 seconds 00000100:00100000:0.0:1788845977.407064:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739039232 00000100:00100000:0.0:1788845977.407069:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739039232 00000100:00100000:0.0:1788845977.407117:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788845977.407124:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5849:x1875740739039232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788845977.407214:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5849:x1875740739039232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 80us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845977.407221:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788845977.407354:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845977.407455:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875740739039232:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788845977.407786:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788845977.407831:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875740739039360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788845977.413447:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845977.413533:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074aa000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845977.418307:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739039360 00000100:00100000:0.0:1788845977.418320:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739039360 00000100:00100000:1.0:1788845977.425789:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788845977.425803:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5849:x1875740739039360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788845977.426102:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5849:x1875740739039360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 301us (12659us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788845977.426111:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788845977.426148:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875740739039360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788845977.426252:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788845977.426294:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.426304:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.426310:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.426316:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845977.426320:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.426327:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.426353:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164100) 00010000:00010000:2.0:1788845977.426356:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788845977.426361:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.426367:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773f668 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788845977.426546:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788845977.426645:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788845977.426657:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 309643502938ns, next at 310643500718ns, rc = 0 00000001:00080000:2.0:1788845977.426664:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788845977.426709:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164100) 00010000:00010000:2.0:1788845977.426713:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788845977.426719:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f653 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce46 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845977.426808:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+45:10512:x1875740720152576:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 25282us (25494us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788845977.426816:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000020:00080000:2.0:1788845977.426820:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788845977.433217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.433319:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720152832 00000100:00100000:3.0:1788845977.433329:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720152832 00000100:00100000:3.0:1788845977.433386:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 100 00000100:00100000:3.0:1788845977.433396:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+45:10512:x1875740720152832:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845977.433417:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845977.433438:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f66f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce4d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.433509:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f66f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce4d expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.433524:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f66f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce4d expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.433563:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:3.0:1788845977.433566:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845977.433570:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f57800, rc 0) 00000100:00100000:3.0:1788845977.433628:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+46:10512:x1875740720152832:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 233us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845977.433645:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 100 00000100:00100000:1.0:1788845977.436943:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.440355:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720153088 00000100:00100000:0.0:1788845977.440378:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720153088 00000100:00100000:0.0:1788845977.440450:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:0.0:1788845977.440460:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+46:10512:x1875740720153088:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788845977.440704:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+47:10512:x1875740720153088:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 245us (3768us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788845977.440712:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:0.0:1788845977.518244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.520238:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720153216 00000100:00100000:0.0:1788845977.520259:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720153216 00000100:00100000:0.0:1788845977.520392:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 101 00000100:00100000:0.0:1788845977.520402:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+47:10522:x1875740720153216:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:0.0:1788845977.520472:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f676 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520488:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520502:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520515:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f67d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520522:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f67d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520528:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f67d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520604:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520613:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520620:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788845977.520655:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520677:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f676 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520697:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f676 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520703:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f676 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520708:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845977.520713:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f676 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520720:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f676 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520732:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:0.0:1788845977.520734:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845977.520738:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f676 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520744:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f676 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520756:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f67d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520763:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f67d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520769:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f67d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520780:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845977.520783:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f67d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520811:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f67d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520821:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c11677200) 00010000:00010000:0.0:1788845977.520824:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845977.520827:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f67d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520832:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f67d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520845:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520851:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f684 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520857:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520861:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845977.520864:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520869:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f684 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520887:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:0.0:1788845977.520889:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845977.520892:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f684 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.520897:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845977.520973:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+47:10522:x1875740720153216:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 572us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845977.520989:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 101 00000100:00100000:1.0:1788845977.568743:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.569726:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720153472 00000100:00100000:0.0:1788845977.569737:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720153472 00000100:00100000:0.0:1788845977.569839:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 102 00000100:00100000:0.0:1788845977.569850:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+47:10526:x1875740720153472:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845977.569870:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845977.569887:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f68b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce54 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.569952:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f692 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.569966:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f692 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.569978:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f692 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.569992:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f699 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570023:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570030:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845977.570052:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1788845977.570088:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:0.0:1788845977.570249:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f6a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570331:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570342:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845977.570351:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788845977.570437:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f692 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570620:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f692 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570628:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f692 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570634:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845977.570638:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f692 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570645:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f692 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570730:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:0.0:1788845977.570733:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845977.570738:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f692 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570745:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f692 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570759:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570765:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f699 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570769:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f699 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570774:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845977.570777:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f699 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570783:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f699 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570790:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c11677100) 00010000:00010000:0.0:1788845977.570792:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845977.570795:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f699 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570801:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f699 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570852:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f68b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce54 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570863:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce54 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.570870:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:0.0:1788845977.570872:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845977.570874:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce200, rc 0) 00000100:00100000:0.0:1788845977.570942:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+49:10526:x1875740720153472:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1093us (2207us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788845977.570950:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 102 00000100:00100000:2.0:1788845977.575260:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.578140:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720153600 00000100:00100000:3.0:1788845977.578168:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720153600 00000100:00100000:3.0:1788845977.578238:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 103 00000100:00100000:3.0:1788845977.578249:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+49:10526:x1875740720153600:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:3.0:1788845977.578314:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.578332:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.578344:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.578369:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.578376:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.578382:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.578388:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845977.578406:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.578413:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.578425:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:3.0:1788845977.578429:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788845977.578435:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.578508:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845977.579431:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+49:10526:x1875740720153600:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 1179us (4175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845977.579450:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 103 00000100:00100000:2.0:1788845977.586861:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.586946:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720153856 00000100:00100000:0.0:1788845977.586956:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720153856 00000100:00100000:0.0:1788845977.587022:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:0.0:1788845977.587035:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+49:10526:x1875740720153856:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788845977.587421:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+50:10526:x1875740720153856:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 388us (567us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788845977.587429:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:2.0:1788845977.671342:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.671429:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720154112 00000100:00100000:3.0:1788845977.671439:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720154112 00000100:00100000:3.0:1788845977.671499:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 104 00000100:00100000:3.0:1788845977.671509:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+50:10536:x1875740720154112:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1788845977.671532:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845977.671536:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788845977.671560:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f630 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce38 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.671579:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:3.0:1788845977.671583:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845977.671595:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce5b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.672205:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.672222:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f6a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce54 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.672231:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.672263:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce54 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.672276:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f6a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce54 expref: 50 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845977.672290:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d9edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739039488:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845977.672384:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3c973d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845977.674341:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d9edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739039488:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845977.674365:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845977.674583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.674642:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720154240 00000100:00100000:0.0:1788845977.674649:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720154240 00010000:00010000:0.0:1788845977.674687:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f6a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce54 expref: 51 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845977.674720:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:0.0:1788845977.674729:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+51:2353:x1875740720154240:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845977.674751:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845977.674758:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f6a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce54 expref: 51 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.674770:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce54 expref: 51 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.674789:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f6a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce54 expref: 51 pid: 5846 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.674803:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:0.0:1788845977.674808:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.674816:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.674823:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.674853:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845977.674898:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+50:2353:x1875740720154240:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 169us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845977.674905:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00010000:00010000:1.0:1788845977.675191:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.675199:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845977.675227:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788845977.675357:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce5b expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.675374:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce5b expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.675382:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:1.0:1788845977.675384:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788845977.675387:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f57200, rc 0) 00000100:00100000:1.0:1788845977.675429:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+50:10536:x1875740720154112:12345-192.168.206.48@tcp:101:bash.0 Request processed in 3922us (4095us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788845977.675437:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 104 00000100:00100000:2.0:1788845977.679902:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.679976:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720154496 00000100:00100000:0.0:1788845977.679985:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720154496 00000100:00100000:0.0:1788845977.680048:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 105 00000100:00100000:0.0:1788845977.680058:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+50:10536:x1875740720154496:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:0.0:1788845977.680338:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f6ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.680355:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.680368:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845977.680419:0:7134:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788845977.680444:0:7134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a40d0c9c reply state 000000005f010e33 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845977.680452:0:7134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845977.680637:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+53:10536:x1875740720154496:12345-192.168.206.48@tcp:36:bash.0 Request processed in 579us (741us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788845977.680645:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 105 00000020:00080000:0.0:1788845977.680725:0:7134:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788845977.690216:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f6ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.690233:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f6ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.690241:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f6ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.690247:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845977.690252:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f6ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.690264:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f6ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.690293:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:0.0:1788845977.690296:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845977.690301:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f6ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.690307:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f6ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845977.693039:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.693104:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720154624 00000100:00100000:0.0:1788845977.693114:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720154624 00000100:00100000:0.0:1788845977.693202:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 106 00000100:00100000:0.0:1788845977.693213:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+52:10536:x1875740720154624:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788845977.693234:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845977.693251:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f6d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce62 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.693325:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.693340:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce5b expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.693348:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.693400:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce5b expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.693414:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce5b expref: 53 pid: 5847 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845977.693440:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739039616:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845977.693509:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c41752240 going to sleep for 11 seconds 00000100:00100000:2.0:1788845977.696024:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.696066:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739039616:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845977.696094:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720154752 00010000:00010000:0.0:1788845977.696095:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845977.696103:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720154752 00010000:00010000:3.0:1788845977.696146:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce5b expref: 54 pid: 5847 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845977.696212:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:3.0:1788845977.696235:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+54:2353:x1875740720154752:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845977.696363:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845977.696371:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce5b expref: 54 pid: 5847 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.696384:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce5b expref: 54 pid: 5847 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.696405:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce5b expref: 54 pid: 5847 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.696420:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:3.0:1788845977.696425:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.696434:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.696442:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.696475:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845977.696528:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.696860:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845977.696901:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788845977.696906:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845977.696927:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.696971:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f6d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce62 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845977.696988:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+53:2353:x1875740720154752:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 751us (979us total) trans 0 rc 0/0 00010000:00010000:1.0:1788845977.696990:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce62 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.697023:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:1.0:1788845977.697026:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845977.697029:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce000, rc 0) 00000100:00100000:1.0:1788845977.697059:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+53:10536:x1875740720154624:12345-192.168.206.48@tcp:101:bash.0 Request processed in 3848us (4028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845977.697067:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 106 00000100:00100000:3.0:1788845977.699726:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:2.0:1788845977.700909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.702027:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720155008 00000100:00100000:0.0:1788845977.702038:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720155008 00000100:00100000:0.0:1788845977.702101:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:0.0:1788845977.702111:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+52:10536:x1875740720155008:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:0.0:1788845977.702364:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+53:10536:x1875740720155008:12345-192.168.206.48@tcp:35:bash.0 Request processed in 253us (1460us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788845977.702372:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:2.0:1788845977.773146:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.773331:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720155136 00000100:00100000:3.0:1788845977.773340:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720155136 00000100:00100000:3.0:1788845977.773440:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 107 00000100:00100000:3.0:1788845977.773451:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+53:10542:x1875740720155136:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845977.773499:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845977.773519:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.773595:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.773611:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.773623:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845977.773656:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788845977.773659:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845977.773676:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.773698:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f6df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce69 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.773717:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce69 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.773727:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:3.0:1788845977.773730:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788845977.773733:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f57600, rc 0) 00000100:00100000:3.0:1788845977.773794:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+54:10542:x1875740720155136:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 345us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845977.773802:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 107 00000100:00100000:2.0:1788845977.779953:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845977.780073:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720155264 00000100:00100000:1.0:1788845977.780147:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720155264 00000100:00100000:1.0:1788845977.780349:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 108 00000100:00100000:1.0:1788845977.780359:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+54:10542:x1875740720155264:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788845977.780378:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845977.780397:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773f6ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce70 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780456:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f6f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780471:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f6f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780655:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f6f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780673:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f6fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780681:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780706:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780783:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f702 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780791:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780798:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845977.780828:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788845977.780832:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845977.780847:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780858:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780866:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f6f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780872:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f6f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780879:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f6f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780884:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845977.780888:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f6f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780901:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f6f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780913:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:1.0:1788845977.780917:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845977.780921:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f6f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780926:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773f6f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780939:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780945:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f6fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780951:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f6fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780956:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845977.780958:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f6fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780965:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f6fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780972:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c10382300) 00010000:00010000:1.0:1788845977.780975:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845977.780978:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f6fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.780994:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773f6fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.781037:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773f6ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce70 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.781052:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce70 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845977.781060:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:1.0:1788845977.781063:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845977.781065:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00c00, rc 0) 00000100:00100000:1.0:1788845977.781341:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+55:10542:x1875740720155264:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 982us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845977.781350:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 108 00000100:00100000:2.0:1788845977.785295:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845977.785330:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845977.785416:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720155648 00000100:00100000:1.0:1788845977.785430:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720155648 00000100:00100000:0.0:1788845977.785818:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720155520 00000100:00100000:0.0:1788845977.785824:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720155520 00000100:00100000:0.0:1788845977.785863:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 109 00000100:00100000:0.0:1788845977.785873:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+56:10542:x1875740720155520:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845977.785890:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845977.785909:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f709 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce77 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.785995:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.786008:0:7134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce62 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.786044:0:7134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f702 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce70 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.786052:0:7134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00100000:0.0:1788845977.786073:0:7134:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0x1345bc80c773f702 req@ffff9a0c3eb99c00 x1875740720155648/t0(0) o103->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:328/0 lens 328/0 e 0 to 0 dl 1788845988 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788845977.786174:0:7134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce70 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.786189:0:7134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f702 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce70 expref: 57 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845977.786215:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739039744:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845977.786264:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:3.0:1788845977.786272:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+57:2354:x1875740720155648:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845977.786287:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845977.786293:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f702 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce70 expref: 57 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.786305:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f702 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce70 expref: 57 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.786323:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:3.0:1788845977.786327:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.786334:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.786340:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845977.786369:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+57:2354:x1875740720155648:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 98us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845977.786375:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 54 00010000:00010000:2.0:1788845977.786814:0:7134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce62 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.786834:0:7134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce62 expref: 56 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845977.786844:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb99880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739039872:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845977.786883:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c41752540 going to sleep for 11 seconds 00010000:00010000:0.0:1788845977.790094:0:7134:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.48@tcp) returned -22 from blocking AST (req@0000000092bd6577 x1875740739039744) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f702 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce70 expref: 56 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.790117:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773f702 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce70 expref: 56 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845977.790131:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739039744:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845977.791967:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb99880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739039872:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788845977.791995:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:0.0:1788845977.792002:0:7134:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.792024:0:7134:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.792033:0:7134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845977.793781:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.794310:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720155776 00000100:00100000:3.0:1788845977.794319:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720155776 00010000:00010000:3.0:1788845977.794356:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce62 expref: 56 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845977.794432:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:3.0:1788845977.794443:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c02d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+56:2354:x1875740720155776:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845977.794456:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845977.794475:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce62 expref: 56 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.794496:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce62 expref: 56 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.794529:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f6d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce62 expref: 56 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.794543:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:3.0:1788845977.794547:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.794725:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.794733:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845977.794765:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845977.794822:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c02d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+55:2354:x1875740720155776:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 381us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845977.794831:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00010000:00010000:0.0:1788845977.795109:0:7134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.795119:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845977.795136:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788845977.795280:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f709 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce77 expref: 56 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.795296:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce77 expref: 55 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.795303:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:0.0:1788845977.795306:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788845977.795308:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcf800, rc 0) 00000100:00100000:0.0:1788845977.795350:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+55:10542:x1875740720155520:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 9479us (10069us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788845977.795358:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 109 00000100:00100000:0.0:1788845977.801325:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845977.801385:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720156032 00000100:00100000:3.0:1788845977.801394:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720156032 00000100:00100000:2.0:1788845977.801552:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1788845977.801684:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+55:10542:x1875740720156032:12345-192.168.206.48@tcp:103:lfs.0 00010000:00010000:2.0:1788845977.801702:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845977.801726:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f66f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce4d expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.801744:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:2.0:1788845977.801748:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845977.801805:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+54:10542:x1875740720156032:12345-192.168.206.48@tcp:103:lfs.0 Request processed in 244us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845977.801812:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:1.0:1788845977.803903:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845977.804221:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720156160 00000100:00100000:0.0:1788845977.804230:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720156160 00000100:00100000:0.0:1788845977.804277:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 110 00000100:00100000:0.0:1788845977.804286:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+54:10542:x1875740720156160:12345-192.168.206.48@tcp:58:lfs.0 00010000:00010000:0.0:1788845977.804402:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f71e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.804425:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f71e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845977.804436:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f71e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788845977.804642:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788845977.804721:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+54:10542:x1875740720156160:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 435us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845977.804730:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 110 00000100:00100000:1.0:1788845977.810767:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845977.812848:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720156288 00000100:00100000:2.0:1788845977.812861:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720156288 00000100:00100000:2.0:1788845977.812924:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 111 00000100:00100000:2.0:1788845977.812934:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+54:10542:x1875740720156288:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845977.812965:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845977.812985:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f725 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce7e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.813051:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f71e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.813062:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f725 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce7e expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.813080:0:5845:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f71e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.813094:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f725 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce7e expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.813107:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:2.0:1788845977.813110:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788845977.813114:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f725 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce7e expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845977.813122:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00031600, rc 0) 00000100:00100000:2.0:1788845977.813209:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+55:10542:x1875740720156288:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 276us (2449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845977.813215:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 111 00010000:00010000:0.0:1788845978.278471:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788845978.278496:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788845978.278561:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788845978.278614:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788845978.278735:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788845978.279150:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb9b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875740739040000:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788845978.279326:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074aaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788845978.284032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.284190:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720156416 00000100:00100000:2.0:1788845978.284200:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720156416 00000100:00100000:2.0:1788845978.284256:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:2.0:1788845978.284267:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+56:10543:x1875740720156416:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788845978.284298:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788845978.284648:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+56:10543:x1875740720156416:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 382us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845978.284656:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:0.0:1788845978.285087:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb9b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875740739040000:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788845978.290874:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.290964:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720156544 00000100:00100000:2.0:1788845978.290973:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720156544 00000100:00100000:2.0:1788845978.291038:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:2.0:1788845978.291048:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+55:10543:x1875740720156544:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788845978.291119:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f72c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291134:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f72c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291146:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f72c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291231:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f733 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291239:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f733 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291261:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f733 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291284:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f73a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291291:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f73a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291297:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f73a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845978.291332:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788845978.291336:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845978.291348:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f73a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291357:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f72c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291363:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f72c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291369:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f72c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291375:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845978.291379:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f72c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291386:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f72c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291406:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f200) 00010000:00010000:2.0:1788845978.291409:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845978.291430:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f72c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291437:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f72c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291673:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f733 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291749:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f733 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291756:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f733 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291761:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845978.291765:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f733 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291771:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f733 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291781:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845978.291783:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845978.291786:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f733 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291793:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f733 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291821:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f73a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291827:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f73a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291833:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f73a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291838:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845978.291841:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f73a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291847:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f73a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291855:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:2.0:1788845978.291857:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845978.291860:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f73a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.291866:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f73a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845978.291992:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+55:10543:x1875740720156544:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 943us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845978.292001:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:3.0:1788845978.299191:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845978.299368:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720156800 00000100:00100000:1.0:1788845978.299378:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720156800 00000100:00100000:1.0:1788845978.299432:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:1.0:1788845978.299608:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+55:10543:x1875740720156800:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845978.299626:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845978.299748:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f741 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce85 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.299888:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f748 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.299902:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.299913:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845978.299924:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788845978.300007:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.300025:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f748 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.300032:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.300037:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845978.300041:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.300047:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f748 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.300058:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:1.0:1788845978.300061:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788845978.300065:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f748 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.300089:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773f748 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.300127:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f741 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce85 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.300137:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f200) 00010000:00010000:1.0:1788845978.300139:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788845978.300143:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773f741 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce85 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.300549:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01600, rc 0) 00000100:00100000:1.0:1788845978.300629:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+56:10543:x1875740720156800:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 1187us (1476us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788845978.300637:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:1.0:1788845978.310431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845978.310892:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720156928 00000100:00100000:0.0:1788845978.310902:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720156928 00000100:00100000:0.0:1788845978.310962:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:0.0:1788845978.310973:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+56:10543:x1875740720156928:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788845978.311019:0:7134:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788845978.312055:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+56:10543:x1875740720156928:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 1078us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845978.312066:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:0.0:1788845978.316100:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.316193:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720157184 00000100:00100000:2.0:1788845978.316202:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720157184 00000100:00100000:2.0:1788845978.316258:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:2.0:1788845978.316279:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+56:10543:x1875740720157184:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845978.316300:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845978.316304:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788845978.316329:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f6e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce69 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.316348:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:2.0:1788845978.316353:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845978.316365:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f756 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce8c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788845978.316764:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788845978.316950:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f75d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.316965:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f75d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.316975:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f75d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.317036:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f756 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce8c expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.317053:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f75d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce8c expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.317062:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845978.317065:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845978.317076:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00031000, rc 0) 00000100:00100000:2.0:1788845978.317144:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+57:10543:x1875740720157184:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 865us (1052us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788845978.317207:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:3.0:1788845978.328293:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.328688:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720157440 00000100:00100000:2.0:1788845978.328698:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720157440 00000100:00100000:2.0:1788845978.328805:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:2.0:1788845978.328816:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+57:10543:x1875740720157440:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788845978.328874:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845978.328899:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f75d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce8c expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.328919:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845978.328928:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845978.328946:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f76b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.328958:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f76b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.328968:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f76b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329025:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f772 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd38c4a8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329033:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f772 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd38c4a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329040:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f772 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd38c4a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329111:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f76b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329119:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f76b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329125:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f76b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329131:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845978.329135:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f76b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329142:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f76b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329199:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:2.0:1788845978.329203:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845978.329207:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f76b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329214:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f76b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329225:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f772 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd38c4a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329232:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f772 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd38c4a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329238:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f772 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd38c4a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329250:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845978.329253:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f772 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd38c4a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329260:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f772 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd38c4a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329268:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd38c4a8d (ffff9a0c04c4f800) 00010000:00010000:2.0:1788845978.329271:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845978.329273:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f772 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd38c4a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.329279:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f772 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd38c4a8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845978.329364:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+56:10543:x1875740720157440:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 549us (1079us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788845978.329373:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:3.0:1788845978.332792:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.332866:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720157568 00000100:00100000:2.0:1788845978.332874:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720157568 00000100:00100000:2.0:1788845978.332922:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:2.0:1788845978.332931:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+56:10543:x1875740720157568:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845978.332947:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845978.332965:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f779 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce93 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.332996:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f780 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.333036:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.333047:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.333126:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f779 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce93 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.333143:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce93 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.333184:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:2.0:1788845978.333188:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788845978.333191:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030c00, rc 0) 00000100:00100000:2.0:1788845978.333241:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+57:10543:x1875740720157568:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 311us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845978.333248:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:3.0:1788845978.336464:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845978.336565:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720157824 00000100:00100000:0.0:1788845978.336574:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720157824 00000100:00100000:0.0:1788845978.336624:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:0.0:1788845978.336634:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+57:10543:x1875740720157824:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788845978.336735:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f787 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.336752:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f787 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.336764:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f787 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788845978.336982:0:7134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1788845978.336992:0:7134:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 310553837959ns, next at 311553835764ns, rc = 0 00000004:00010000:0.0:1788845978.337095:0:7134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bac20f43 reply state 00000000730429b9 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f787 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845978.337103:0:7134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845978.337324:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+59:10543:x1875740720157824:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 690us (866us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788845978.337331:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:0.0:1788845978.341764:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.341835:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720157952 00000100:00100000:2.0:1788845978.341844:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720157952 00000100:00100000:2.0:1788845978.341893:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:2.0:1788845978.341904:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+59:10543:x1875740720157952:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845978.341926:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845978.341944:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f78e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ce9a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.342023:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f78e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce9a expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.342059:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f78e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce9a expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.342082:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:2.0:1788845978.342085:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788845978.342089:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00031000, rc 0) 00000100:00100000:2.0:1788845978.342179:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+60:10543:x1875740720157952:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 251us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845978.342187:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 120 00010000:00010000:1.0:1788845978.343195:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f787 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.343209:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f787 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.343216:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f787 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.343223:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845978.343228:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f787 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.343249:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f787 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.343263:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:1.0:1788845978.343266:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788845978.343270:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f787 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.343277:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f787 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845978.345986:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845978.346093:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720158080 00000100:00100000:1.0:1788845978.346104:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720158080 00000100:00100000:1.0:1788845978.346194:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:1.0:1788845978.346204:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:2353:x1875740720158080:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788845978.346467:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+9:2353:x1875740720158080:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 264us (490us total) trans 4294967307 rc 0/0 00000100:00080000:3.0:1788845978.346507:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845978.351272:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.351362:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720158336 00000100:00100000:2.0:1788845978.351372:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720158336 00000100:00100000:2.0:1788845978.351426:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:2.0:1788845978.351435:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+59:10543:x1875740720158336:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788845978.351626:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+60:10543:x1875740720158336:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 192us (361us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788845978.351633:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:1.0:1788845978.355457:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:0.0:1788845978.366405:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.368842:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720158592 00000100:00100000:2.0:1788845978.368855:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720158592 00000100:00100000:2.0:1788845978.368927:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:2.0:1788845978.368938:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+60:10543:x1875740720158592:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788845978.369311:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+60:10543:x1875740720158592:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 373us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845978.369320:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:0.0:1788845978.375699:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845978.376072:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720158720 00000100:00100000:3.0:1788845978.376091:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720158720 00000100:00100000:3.0:1788845978.376246:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:3.0:1788845978.376256:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+60:10543:x1875740720158720:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788845978.376275:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845978.376292:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f795 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cea1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.376355:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f79c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.376369:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.376380:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845978.376411:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845978.376432:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.376455:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f795 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cea1 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.376472:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f79c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cea1 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.376480:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:3.0:1788845978.376494:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788845978.376497:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f57600, rc 0) 00000100:00100000:3.0:1788845978.376652:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+61:10543:x1875740720158720:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 396us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845978.376659:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:1.0:1788845978.388746:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845978.389616:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720158848 00000100:00100000:3.0:1788845978.389628:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720158848 00000100:00100000:3.0:1788845978.389691:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:3.0:1788845978.389702:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+9:2354:x1875740720158848:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788845978.389719:0:8094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845978.389739:0:8094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9bd7750/0x1345bc80c773f7a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cea8 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845978.389767:0:8094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9f9a, blocks: 0x1 00010000:00010000:3.0:1788845978.389786:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:3.0:1788845978.389790:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845978.389800:0:8094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9bd7750/0x1345bc80c773f7a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cea8 expref: 10 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.389817:0:8094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9bd7750/0x1345bc80c773f7a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cea8 expref: 10 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.389831:0:8094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f57800, rc 0) 00000100:00100000:3.0:1788845978.389893:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+10:2354:x1875740720158848:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 193us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845978.389900:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:0.0:1788845978.399886:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845978.399982:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720159104 00000100:00100000:3.0:1788845978.399992:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720159104 00000100:00100000:3.0:1788845978.400061:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:3.0:1788845978.400072:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+61:10543:x1875740720159104:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788845978.400207:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+61:10543:x1875740720159104:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 136us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845978.400215:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:1.0:1788845978.411991:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.412106:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720159232 00000100:00100000:2.0:1788845978.412127:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720159232 00000100:00100000:2.0:1788845978.412514:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:2.0:1788845978.412526:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+10:10543:x1875740720159232:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845978.412544:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845978.412572:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f7aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ceaf expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.412608:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9bd7750/0x1345bc80c773f7a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cea8 expref: 11 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.412617:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845978.412621:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845978.412625:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f7aa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceaf expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.412659:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9bd7750/0x1345bc80c773f7a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cea8 expref: 11 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.412673:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9bd7750/0x1345bc80c773f7a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cea8 expref: 11 pid: 8094 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845978.412687:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1875740739040128:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845978.412768:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074aa540 going to sleep for 11 seconds 00000100:00100000:3.0:1788845978.415727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845978.415823:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720159360 00000100:00100000:0.0:1788845978.415832:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720159360 00010000:00010000:0.0:1788845978.415870:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9bd7750/0x1345bc80c773f7a3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cea8 expref: 12 pid: 8094 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845978.415912:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:0.0:1788845978.415921:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cface00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+12:2353:x1875740720159360:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845978.415942:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845978.415964:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9bd7750/0x1345bc80c773f7a3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cea8 expref: 12 pid: 8094 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.415978:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9bd7750/0x1345bc80c773f7a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cea8 expref: 12 pid: 8094 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.416002:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845978.416018:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845978.416027:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f7aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceaf expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.416038:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f7aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceaf expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.416085:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f7aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceaf expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845978.416099:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb93800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1875740739040256:192.168.206.48@tcp:105: 00000100:00100000:0.0:1788845978.416203:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c41752f00 going to sleep for 11 seconds 00010000:00010000:2.0:1788845978.417396:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9bd7750/0x1345bc80c773f7a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cea8 expref: 12 pid: 8094 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845978.417433:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1875740739040128:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845978.417458:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f7aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceaf expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.417470:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030600, rc 0) 00000100:00100000:2.0:1788845978.417532:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+11:10543:x1875740720159232:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 5008us (5553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845978.417540:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:0.0:1788845978.421548:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb93800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1875740739040256:192.168.206.48@tcp:105: 00010000:00010000:0.0:1788845978.421584:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845978.421642:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cface00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+10:2353:x1875740720159360:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 5721us (5925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845978.421652:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:0.0:1788845978.422829:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845978.423031:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720159488 00000100:00100000:3.0:1788845978.423039:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720159488 00002000:00100000:3.0:1788845978.423107:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a0c3eb93800 x1875740720159488/t0(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:329/0 lens 504/0 e 0 to 0 dl 1788845989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845978.423118:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3eb93800 with x1875740720159488 ext(0->12) 00002000:00010000:3.0:1788845978.423123:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c3eb93800 00000100:00100000:3.0:1788845978.423171:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:3.0:1788845978.423182:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4592a189-21d8-449a-9335-07bfe0dc7877+10:2354:x1875740720159488:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788845978.423847:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4592a189-21d8-449a-9335-07bfe0dc7877+12:2354:x1875740720159488:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 Request processed in 663us (1021us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788845978.423857:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00002000:00100000:3.0:1788845978.423865:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a0c3eb93800 x1875740720159488/t4294967308(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:329/0 lens 504/448 e 0 to 0 dl 1788845989 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845978.423874:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3eb93800 with x1875740720159488 ext(0->12) 00002000:00010000:3.0:1788845978.423878:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c3eb93800 00000100:00100000:3.0:1788845978.428134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.428972:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720159616 00000100:00100000:2.0:1788845978.428982:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720159616 00000100:00100000:0.0:1788845978.429436:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 124 00000100:00100000:0.0:1788845978.429457:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+61:10543:x1875740720159616:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788845978.464477:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+61:10543:x1875740720159616:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 33094us (34423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845978.464493:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 124 00000001:00080000:3.0:1788845978.465018:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1788845978.465038:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788845978.465095:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1788845978.465146:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788845978.465176:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:3.0:1788845978.465241:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788845978.465248:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788845978.465269:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a0c0688f0c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788845978.465274:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c206c7a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c075c9240 00000020:00080000:3.0:1788845978.465277:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c206c7200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c050a6c00 00000004:00080000:3.0:1788845978.465287:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788845978.465310:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a0c263e5c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788845978.465312:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c206c7c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c263e5180 00000020:00080000:3.0:1788845978.465314:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c206c7000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c3cf46800 00000100:00100000:2.0:1788845978.465727:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845978.465744:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739040384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788845978.465804:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845978.465847:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739040384 00000100:00100000:2.0:1788845978.465854:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739040384 00000100:00100000:2.0:1788845978.465895:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788845978.465902:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739040384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788845978.465927:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1788845978.465958:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f9f99, atime: 0x6a9f9f99, ctime: 0x6a9f9f99, blocks: 0xb 00010000:00010000:2.0:1788845978.465966:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f7b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.465983:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=310s v=(0 0) 00010000:00010000:2.0:1788845978.465996:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845978.466003:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f7b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.466032:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f7b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.466041:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f7b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.466048:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.466067:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788845978.466866:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739040640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788845978.466890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845978.466955:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739040512:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788845978.466992:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845978.467116:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720159744 00000100:00100000:0.0:1788845978.467122:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720159744 00000100:00100000:0.0:1788845978.467181:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739040512 00000100:00100000:0.0:1788845978.467184:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739040512 00000100:00100000:0.0:1788845978.467211:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:0.0:1788845978.467219:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+12:2353:x1875740720159744:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788845978.467268:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788845978.467291:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845978.467345:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739040640 00000100:00100000:3.0:1788845978.467349:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739040640 00000100:00100000:3.0:1788845978.467449:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788845978.467458:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3309:x1875740739040512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788845978.467472:0:11681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1788845978.467490:0:11681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.467507:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773f573 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce0e expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.467516:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788845978.467520:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845978.467533:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.467809:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773f573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce0e expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.467823:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773f573 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce0e expref: 12 pid: 6689 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845978.467835:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cfaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11681:1875740739040768:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845978.467900:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3c973300 going to sleep for 11 seconds 00000100:00100000:2.0:1788845978.469147:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739040384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3240us (3338us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788845978.469175:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788845978.469204:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788845978.469213:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c077e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1875740739040640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788845978.469322:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788845978.469326:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788845978 00002000:00010000:2.0:1788845978.469328:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788845978.469330:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788845978 -> 1788845978 00002000:00010000:2.0:1788845978.469333:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788845978.469450:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c077e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3310:x1875740739040640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 238us (2180us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788845978.469457:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1788845978.469487:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845978.469495:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.469506:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:2.0:1788845978.469510:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f7b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.469520:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f7b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.469539:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f7b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.469546:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb3d190e/0x1345bc80c773f7b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.469564:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845978.469566:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845978.469567:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788845978.469863:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788845978.469997:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788845978.474707:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788845978.474716:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1788845978.474735:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a0c3cf3e680, transno 4294967301 00000004:00080000:0.0:1788845978.474751:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1788845978.474768:0:3307:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9a0c3eb9b100 x1875740739040384/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788845994 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788845978.474781:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a0c3eb9b100/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788845978.474785:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739040384:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788845978.474932:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a0c3eb90380/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788845978.474938:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739040640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788845978.475937:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.476022:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720159872 00000100:00100000:2.0:1788845978.476030:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720159872 00010000:00010000:2.0:1788845978.476072:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773f573 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce0e expref: 13 pid: 6689 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845978.476116:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:2.0:1788845978.476134:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+13:2354:x1875740720159872:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845978.476149:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845978.476175:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773f573 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce0e expref: 13 pid: 6689 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.476189:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773f573 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce0e expref: 13 pid: 6689 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.476217:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788845978.476221:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788845978.476227:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.476237:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.476257:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845978.476304:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+13:2354:x1875740720159872:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 171us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845978.476312:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00010000:00010000:3.0:1788845978.476894:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773f573 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce0e expref: 12 pid: 6689 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845978.476910:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cfaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11681:1875740739040768:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845978.476927:0:11681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.476937:0:11681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.476944:0:11681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.476967:0:11681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.476974:0:11681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.476998:0:11681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788845978.477033:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845978.477040:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.477054:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57200 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788845978.477058:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.477067:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.477084:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.477092:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9b21b5d/0x1345bc80c773f7b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.477108:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845978.477110:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845978.477112:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845978.478238:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3309:x1875740739040512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10777us (11241us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788845978.478249:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:3.0:1788845978.478301:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a0c3eb93480/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788845978.478307:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739040512:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788845978.494467:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+11:2353:x1875740720159744:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 27238us (27570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845978.494480:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000001:00080000:0.0:1788845978.494641:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1788845978.494651:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788845978.494657:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788845978.494665:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1788845978.497924:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845978.498005:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720160128 00000100:00100000:3.0:1788845978.498025:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720160128 00000100:00100000:3.0:1788845978.498092:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:3.0:1788845978.498102:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+15:10543:x1875740720160128:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788845978.498357:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845978.498455:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f79c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cea1 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.498473:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:3.0:1788845978.498478:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845978.498504:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f7bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.498534:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f7bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.498544:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f7bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845978.498775:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c443ab9a reply state 000000001c27ce3e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f7bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845978.498784:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788845978.498876:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+16:10543:x1875740720160128:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 775us (959us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788845978.498884:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 125 00010000:00010000:0.0:1788845978.500862:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f7bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.500885:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f7bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.500892:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f7bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.500898:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845978.500902:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f7bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.500910:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f7bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.500924:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:0.0:1788845978.500927:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845978.500931:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f7bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.500938:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57800/0x1345bc80c773f7bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845978.502307:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845978.502641:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720160256 00000100:00100000:1.0:1788845978.502651:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720160256 00000100:00100000:1.0:1788845978.502706:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:1.0:1788845978.502716:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720160256:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788845978.502904:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788845978.502908:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788845978 -> 1788845977 00002000:00010000:1.0:1788845978.502921:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788845977 00002000:00010000:1.0:1788845978.502924:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788845978 -> 1788845977 00002000:00010000:1.0:1788845978.502926:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788845978.502983:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+7:2353:x1875740720160256:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 268us (683us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788845978.502989:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:3.0:1788845978.505317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845978.505521:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720160512 00000100:00100000:1.0:1788845978.505531:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720160512 00000100:00100000:1.0:1788845978.505593:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:1.0:1788845978.505603:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+15:10543:x1875740720160512:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788845978.505667:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.505684:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f780 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce93 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.505695:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.505730:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce93 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.505744:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f780 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce93 expref: 15 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845978.505758:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d645500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739040896:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788845978.505834:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c34e77f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788845978.508769:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845978.508846:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720160640 00000100:00100000:0.0:1788845978.508855:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720160640 00010000:00010000:0.0:1788845978.508888:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f780 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce93 expref: 16 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845978.508930:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:0.0:1788845978.508939:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+16:2354:x1875740720160640:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845978.508967:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845978.508975:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f780 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce93 expref: 16 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.508988:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f780 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce93 expref: 16 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.509021:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:0.0:1788845978.509027:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.509037:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.509045:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.509064:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845978.509112:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+16:2354:x1875740720160640:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 174us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845978.509120:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00010000:00010000:1.0:1788845978.509729:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f780 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce93 expref: 15 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845978.509757:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d645500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739040896:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788845978.509793:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.509802:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.509808:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.509831:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.509838:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.509844:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.509850:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845978.509854:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.509861:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.509873:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:1.0:1788845978.509875:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788845978.509879:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845978.509890:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773f7c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845978.509931:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+14:10543:x1875740720160512:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 Request processed in 4329us (4621us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788845978.509939:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:2.0:1788845978.512490:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845978.512575:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720160768 00000100:00100000:3.0:1788845978.512585:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720160768 00000100:00100000:3.0:1788845978.512639:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:3.0:1788845978.512649:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+7:2353:x1875740720160768:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788845978.512688:0:8094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.512707:0:8094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f7aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceaf expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.512714:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845978.512724:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845978.512742:0:8094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.512776:0:8094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f7aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceaf expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.512788:0:8094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f7aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceaf expref: 7 pid: 6689 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845978.512799:0:8094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cfaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8094:1875740739041024:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845978.512859:0:8094:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c261ec840 going to sleep for 11 seconds 00000100:00100000:2.0:1788845978.517467:0:8094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cfaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8094:1875740739041024:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845978.517660:0:8094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845978.517804:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.517942:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720160896 00000100:00100000:2.0:1788845978.517961:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720160896 00010000:00010000:2.0:1788845978.517994:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f7aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceaf expref: 8 pid: 6689 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845978.518091:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:2.0:1788845978.518101:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+8:2354:x1875740720160896:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845978.518125:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845978.518147:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f7aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceaf expref: 8 pid: 6689 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.518189:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f7aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceaf expref: 8 pid: 6689 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.518212:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f7aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceaf expref: 8 pid: 6689 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.518227:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788845978.518232:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788845978.518238:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.518247:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.518440:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845978.518504:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+7:2354:x1875740720160896:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 404us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845978.518523:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00010000:00010000:3.0:1788845978.518614:0:8094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.518624:0:8094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.518647:0:8094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.518656:0:8094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.518664:0:8094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.518681:0:8094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788845978.518686:0:8094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.518694:0:8094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.518712:0:8094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.518720:0:8094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000876ad92/0x1345bc80c773f7cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845978.518779:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720160768:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 6131us (6296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845978.518786:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:3.0:1788845978.520880:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.520976:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720161152 00000100:00100000:2.0:1788845978.520985:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720161152 00000100:00100000:2.0:1788845978.521069:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 127 00000100:00100000:2.0:1788845978.521079:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+14:10543:x1875740720161152:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788845978.521240:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f7d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.521257:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f7d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.521268:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f7d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.521636:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.521649:0:7134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f78e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce9a expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.521657:0:7134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.521690:0:7134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f78e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce9a expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.521705:0:7134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f78e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce9a expref: 15 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845978.521737:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739041152:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845978.521858:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1788845978.525540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845978.525629:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720161280 00000100:00100000:0.0:1788845978.525639:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720161280 00010000:00010000:0.0:1788845978.525675:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f78e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce9a expref: 16 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845978.525714:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:0.0:1788845978.525723:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+16:2354:x1875740720161280:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845978.525749:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845978.525756:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f78e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce9a expref: 16 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.525768:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f78e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce9a expref: 16 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.525789:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:0.0:1788845978.525804:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.525814:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.525821:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845978.525840:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845978.525894:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+16:2354:x1875740720161280:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 172us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845978.525902:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00010000:00010000:2.0:1788845978.526645:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f78e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce9a expref: 15 pid: 5846 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845978.526664:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739041152:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845978.526684:0:7134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.526692:0:7134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.526698:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845978.526866:0:7134:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788845978.526997:0:7134:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788845978.527053:0:7134:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788845978.527128:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7134:1875740739041280:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788845978.527224:0:7134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845978.527253:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074aa540 going to sleep for 11 seconds 00000100:00100000:1.0:1788845978.527302:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739041280 00000100:00100000:1.0:1788845978.527307:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739041280 00000100:00100000:1.0:1788845978.527347:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845978.527355:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7134:x1875740739041280:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788845978.527490:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7134:x1875740739041280:12345-0@lo:1000:mdt00_003.0 Request processed in 135us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845978.527498:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788845978.527687:0:7134:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788845978.527692:0:7134:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1788845978.527706:0:7134:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a0c3eb90380, transno 4294967309 00000100:00100000:3.0:1788845978.527726:0:7134:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9a0c3eb93480 x1875740739040512/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788845994 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845978.527736:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7134:1875740739041280:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788845978.528410:0:7134:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788845978.528474:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cfae680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7134:1875740739041408:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788845978.528516:0:7134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845978.528643:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c261ecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845978.528692:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739041408 00000100:00100000:1.0:1788845978.528698:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739041408 00000100:00100000:1.0:1788845978.528724:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788845978.528731:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7134:x1875740739041408:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788845978.528917:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7134:x1875740739041408:12345-0@lo:1000:mdt00_003.0 Request processed in 186us (400us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788845978.528925:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788845978.528981:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cfae680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7134:1875740739041408:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788845978.529235:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529245:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529254:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529260:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845978.529264:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529272:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529287:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a0c04c4f100) 00010000:00010000:3.0:1788845978.529290:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845978.529295:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529302:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f7db lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529329:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f71e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529336:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f71e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529349:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f71e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529355:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcfe00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845978.529358:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f71e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529364:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f71e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529372:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:3.0:1788845978.529375:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845978.529381:0:7134:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f725 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce7e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529392:0:7134:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f725 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce7e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529401:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f725 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce7e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.529425:0:7134:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f725 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce7e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845978.529436:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cfad500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739041536:192.168.206.48@tcp:105: 00000100:00100000:3.0:1788845978.529496:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c261ecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845978.533610:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845978.533698:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cfad500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739041536:192.168.206.48@tcp:105: 00010000:00010000:3.0:1788845978.533738:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f71e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533749:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f71e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533776:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f7e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533788:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533799:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533809:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533815:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f7e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533821:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f7e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533827:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845978.533831:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f7e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533838:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f7e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533849:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:3.0:1788845978.533852:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845978.533862:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f7e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533868:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f7e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533878:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f7d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533885:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f7d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533890:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f7d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533895:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845978.533897:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f7d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533903:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f7d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.533910:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:3.0:1788845978.533912:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788845978.533915:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f7d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845978.533918:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720161408 00010000:00010000:3.0:1788845978.533920:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f7d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845978.533924:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720161408 00000100:00100000:2.0:1788845978.533976:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:2.0:1788845978.533985:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+19:10542:x1875740720161408:12345-192.168.206.48@tcp:49:lfs.0 00000100:00100000:3.0:1788845978.534140:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+19:10543:x1875740720161152:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 13061us (13265us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788845978.534140:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+19:10542:x1875740720161408:12345-192.168.206.48@tcp:49:lfs.0 Request processed in 156us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845978.534149:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 127 00000020:00080000:3.0:1788845978.534194:0:7134:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788845978.534234:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00000040:00080000:1.0:1788845978.534616:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845978.534621:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788845978.535101:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788845978.535109:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788845978.537840:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845978.537880:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.538076:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720161664 00000100:00100000:2.0:1788845978.538086:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720161664 00000100:00100000:3.0:1788845978.538194:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720161920 00000100:00100000:3.0:1788845978.538198:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720161920 00000100:00100000:3.0:1788845978.538232:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:3.0:1788845978.538241:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+19:10542:x1875740720161920:12345-192.168.206.48@tcp:58:lfs.0 00000100:00100000:2.0:1788845978.538648:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:2.0:1788845978.538658:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08dc0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+19:10543:x1875740720161664:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788845978.540076:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788845978.540223:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788845978.540276:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f7e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.540293:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.540304:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.540311:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f7e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.540317:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f7e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.540323:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f7e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.540343:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788845978.540443:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08dc0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+21:10543:x1875740720161664:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 1783us (2609us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788845978.540452:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000020:00080000:2.0:1788845978.540471:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788845978.540601:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845978.540608:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f7e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.540616:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788845978.540620:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f7e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.540628:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f7e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.540643:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a0c04c4fb00) 00000040:00080000:0.0:1788845978.540643:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00010000:00010000:3.0:1788845978.540646:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788845978.540651:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f7e9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.540657:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f7e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.540672:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845978.540674:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845978.540675:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845978.540687:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+20:10542:x1875740720161920:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 2447us (2806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845978.540696:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:2.0:1788845978.572853:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845978.572979:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720162048 00000100:00100000:3.0:1788845978.572988:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720162048 00000100:00100000:3.0:1788845978.573057:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 129 00000100:00100000:3.0:1788845978.573067:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+20:10545:x1875740720162048:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845978.573103:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845978.573123:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f7f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ceb6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.578656:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f7f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.578679:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.578691:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.578706:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f7fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.578713:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.578719:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.578928:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f805 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.578942:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce77 expref: 21 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.578951:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f805 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.578984:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce77 expref: 21 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.578999:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce77 expref: 21 pid: 7134 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845978.579032:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875740739041664:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845978.579122:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c263e5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845978.587723:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845978.587830:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720162304 00000100:00100000:1.0:1788845978.587839:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720162304 00000100:00100000:1.0:1788845978.587899:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:1.0:1788845978.587909:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+22:5588:x1875740720162304:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788845978.588142:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+23:5588:x1875740720162304:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 228us (422us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788845978.588331:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:2.0:1788845978.589524:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875740739041664:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845978.589555:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f805 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845978.594058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845978.594203:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720162432 00000100:00100000:2.0:1788845978.594212:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720162432 00010000:00010000:2.0:1788845978.594248:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce77 expref: 23 pid: 7134 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845978.594296:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:2.0:1788845978.594305:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c02d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+23:2353:x1875740720162432:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845978.594319:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845978.594326:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce77 expref: 23 pid: 7134 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.594340:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce77 expref: 23 pid: 7134 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.594361:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f710 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce77 expref: 23 pid: 7134 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.594375:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:2.0:1788845978.594389:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f805 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.594412:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.594420:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f805 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845978.594455:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845978.594507:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c02d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+22:2353:x1875740720162432:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 202us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845978.594514:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00010000:00010000:3.0:1788845978.596232:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596247:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845978.596289:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788845978.596292:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845978.596309:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596323:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596332:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596338:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f7f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596344:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f7f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596349:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845978.596352:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f7f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596387:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f7f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596400:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:3.0:1788845978.596403:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845978.596407:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f7f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596413:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f7f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596426:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596432:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f7fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596437:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f7fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596441:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845978.596443:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f7fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596449:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f7fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596454:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a0c04c4f400) 00010000:00010000:3.0:1788845978.596456:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845978.596459:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f7fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596474:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f7fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596510:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f7f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceb6 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596525:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f805 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceb6 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845978.596533:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:3.0:1788845978.596535:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845978.596537:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00031000, rc 0) 00000100:00100000:3.0:1788845978.596879:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+21:10545:x1875740720162048:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 23810us (24031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845978.596887:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 129 00000100:00100000:3.0:1788845979.046414:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cfadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739041792:0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.046479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845979.046521:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cfafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739042304:0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.046545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845979.046583:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788845979.046589:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cfaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739041920:0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.046609:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845979.046628:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cfad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739042432:0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.046650:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845979.046675:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cfaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739042048:0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.046710:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845979.046728:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845979.046733:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cfaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739042176:0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.046754:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845979.046785:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739041792 00000100:00100000:3.0:1788845979.046792:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739041792 00000100:00100000:3.0:1788845979.046836:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788845979.046845:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739041792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.046891:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739041792:12345-0@lo:400:kworker.0 Request processed in 48us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845979.046898:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788845979.046990:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739042304 00000100:00100000:3.0:1788845979.046994:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739042304 00000100:00100000:3.0:1788845979.047046:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739041920 00000100:00100000:3.0:1788845979.047049:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739041920 00000100:00100000:3.0:1788845979.047061:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739042048 00000100:00100000:3.0:1788845979.047063:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739042048 00000100:00100000:3.0:1788845979.047076:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788845979.047082:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739042304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.047114:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739042304:12345-0@lo:400:kworker.0 Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845979.047121:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788845979.047133:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788845979.047139:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739041920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.047181:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739041920:12345-0@lo:400:kworker.0 Request processed in 42us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845979.047188:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788845979.047208:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788845979.047213:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739042048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.047244:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739042048:12345-0@lo:400:kworker.0 Request processed in 31us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845979.047249:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788845979.047264:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739042432 00000100:00100000:3.0:1788845979.047268:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739042432 00000100:00100000:3.0:1788845979.047288:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739042176 00000100:00100000:3.0:1788845979.047291:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739042176 00000100:00100000:3.0:1788845979.047307:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788845979.047313:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739042432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.047340:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739042432:12345-0@lo:400:kworker.0 Request processed in 27us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845979.047346:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788845979.047356:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788845979.047361:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875740739042176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.047385:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875740739042176:12345-0@lo:400:kworker.0 Request processed in 24us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845979.047390:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788845979.047408:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845979.047412:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845979.047439:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cfaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739042176:0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.047450:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cfaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739042048:0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.047477:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cfaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739041920:0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.047486:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cfad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739042432:0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.047507:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cfadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739041792:0@lo:400:kworker.0 00000100:00100000:3.0:1788845979.047516:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cfafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739042304:0@lo:400:kworker.0 00000100:00100000:2.0:1788845979.047628:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845979.047636:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739042560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845979.047662:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845979.047685:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739042560 00000100:00100000:2.0:1788845979.047688:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739042560 00000100:00100000:2.0:1788845979.047709:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788845979.047714:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875740739042560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845979.047737:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845979.047766:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875740739042560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845979.047772:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788845979.047805:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739042560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788845979.303094:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788845979.312930:0:12099:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788845979.312940:0:12099:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788845979.312988:0:12099:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788845979.312993:0:12099:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788845979.550850:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845979.550943:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845979.550983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845979.551025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845979.551067:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845979.551124:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720162944 00000100:00100000:2.0:1788845979.551145:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720162944 00000100:00100000:2.0:1788845979.551243:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720162816 00000100:00100000:2.0:1788845979.551247:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720162816 00000100:00100000:2.0:1788845979.551271:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:2.0:1788845979.551280:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720162944:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845979.551348:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720162944:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 69us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845979.551356:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:2.0:1788845979.551373:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:2.0:1788845979.551379:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720162816:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845979.551401:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720162816:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 23us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845979.551408:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00080000:2.0:1788845979.551464:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845979.551513:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720162560 00000100:00100000:0.0:1788845979.551519:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720162560 00000100:00100000:0.0:1788845979.551548:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 280 00000100:00100000:0.0:1788845979.551562:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720162560:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788845979.551590:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720162560:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 29us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845979.551596:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 280 00000100:00100000:3.0:1788845979.551668:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720162688 00000100:00100000:3.0:1788845979.552026:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720162688 00000100:00100000:3.0:1788845979.552802:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720163072 00000100:00100000:3.0:1788845979.552808:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720163072 00000100:00100000:1.0:1788845979.552861:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:1.0:1788845979.552873:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+21:2352:x1875740720162688:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845979.552939:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+21:2352:x1875740720162688:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 68us (2097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845979.552946:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00080000:0.0:1788845979.552991:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845979.553488:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:3.0:1788845979.553497:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720163072:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845979.553921:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720163072:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 49us (2477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845979.553929:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 116 00000040:00080000:1.0:1788845979.558427:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845979.558437:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788845979.558495:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788845979.558503:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788845979.558633:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d645c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875740739042688:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788845979.558966:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c109aa480 going to sleep for 11 seconds 00000100:00100000:2.0:1788845979.566882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845979.567293:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720163200 00000100:00100000:3.0:1788845979.567302:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720163200 00000100:00100000:3.0:1788845979.567393:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 130 00000100:00100000:3.0:1788845979.567404:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+22:10557:x1875740720163200:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788845979.567434:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788845979.567563:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+22:10557:x1875740720163200:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 161us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845979.567571:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 130 00000100:00100000:1.0:1788845979.568326:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d645c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875740739042688:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788845979.570765:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845979.571651:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720163456 00000100:00100000:1.0:1788845979.571661:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720163456 00000100:00100000:1.0:1788845979.571788:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:1.0:1788845979.571798:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+21:10557:x1875740720163456:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845979.571819:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845979.571836:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f80c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cebd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845979.571929:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773f813 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845979.571942:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773f813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845979.571953:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773f813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845979.571964:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788845979.572096:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f80c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cebd expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845979.572116:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773f813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cebd expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845979.572125:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:1.0:1788845979.572127:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845979.572131:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01a00, rc 0) 00000100:00100000:1.0:1788845979.572531:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+23:10557:x1875740720163456:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 733us (1772us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788845979.572552:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:0.0:1788845979.579629:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845979.579808:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720163712 00000100:00100000:2.0:1788845979.579817:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720163712 00000100:00100000:2.0:1788845979.579879:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:2.0:1788845979.579889:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+23:10557:x1875740720163712:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788845979.579964:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f821 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845979.579981:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f821 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845979.579995:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f821 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845979.580239:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f821 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845979.580247:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f821 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845979.580254:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f821 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845979.580259:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845979.580263:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f821 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845979.580271:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f821 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845979.580411:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:2.0:1788845979.580414:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788845979.580419:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f821 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845979.580426:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f821 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845979.580599:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+24:10557:x1875740720163712:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 711us (979us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788845979.580608:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:0.0:1788845979.581328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845979.581539:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720163840 00000100:00100000:3.0:1788845979.581546:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720163840 00000100:00100000:3.0:1788845979.581599:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1788845979.581608:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+24:2354:x1875740720163840:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845979.581621:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845979.581639:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773f813 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cebd expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845979.581665:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:3.0:1788845979.581678:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845979.581717:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+23:2354:x1875740720163840:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 110us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845979.581724:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000040:00080000:1.0:1788845979.582696:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845979.582702:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788845979.583631:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000040:00080000:1.0:1788845979.583653:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788845979.583667:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788845979.583784:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720164096 00000100:00100000:2.0:1788845979.583792:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720164096 00000100:00100000:2.0:1788845979.583843:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:2.0:1788845979.583864:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+23:10557:x1875740720164096:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788845979.584798:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+24:10557:x1875740720164096:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 931us (1169us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788845979.584807:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00010000:00010000:0.0:1788845980.326363:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788845981.066620:0:12150:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788845981.066628:0:12150:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788845981.066668:0:12150:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788845981.066673:0:12150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788845981.226568:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845981.226673:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720164352 00000100:00100000:0.0:1788845981.226683:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720164352 00000100:00100000:0.0:1788845981.226800:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 133 00000100:00100000:0.0:1788845981.226811:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+24:10577:x1875740720164352:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845981.226833:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845981.226850:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f828 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cec4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845981.226931:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f82f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845981.226945:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f82f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845981.226958:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f82f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845981.226969:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788845981.227092:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f828 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cec4 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845981.227137:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f82f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cec4 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845981.227145:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:0.0:1788845981.227148:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788845981.227151:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcee00, rc 0) 00000100:00100000:0.0:1788845981.227243:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+26:10577:x1875740720164352:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 434us (682us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788845981.227251:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 133 00000100:00080000:2.0:1788845981.227429:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845981.229869:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845981.230849:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720164480 00000100:00100000:2.0:1788845981.230860:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720164480 00000100:00100000:2.0:1788845981.230991:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 134 00000100:00100000:2.0:1788845981.231015:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+26:10577:x1875740720164480:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:2.0:1788845981.231081:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f83d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845981.231097:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845981.231108:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845981.231132:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845981.231139:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f83d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845981.231145:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f83d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845981.231194:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845981.231198:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f83d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845981.231206:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f83d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845981.231219:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:2.0:1788845981.231222:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845981.231227:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f83d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845981.231233:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030600/0x1345bc80c773f83d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845981.231519:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+26:10577:x1875740720164480:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 503us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845981.231529:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 134 00010000:00010000:1.0:1788845981.350664:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845981.354803:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845981.354902:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720164608 00000100:00100000:2.0:1788845981.354911:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720164608 00000100:00100000:2.0:1788845981.354987:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:2.0:1788845981.355013:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720164608:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:2.0:1788845981.355038:0:11681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845981.355057:0:11681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f844 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cecb expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845981.355081:0:11681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f9f99, atime: 0x6a9f9f99, ctime: 0x6a9f9f99, blocks: 0xb 00010000:00010000:2.0:1788845981.355100:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1788845981.355104:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845981.355113:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cecb expref: 7 pid: 11681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845981.355149:0:11681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cecb expref: 7 pid: 11681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845981.355190:0:11681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030600, rc 0) 00000100:00100000:2.0:1788845981.355247:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4592a189-21d8-449a-9335-07bfe0dc7877+7:2352:x1875740720164608:12345-192.168.206.48@tcp:101:cat.0 Request processed in 237us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845981.355254:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00080000:0.0:1788845981.356672:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845981.361478:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845981.361588:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720164736 00000100:00100000:1.0:1788845981.361597:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720164736 00002000:00100000:1.0:1788845981.361643:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9a0c26324380 x1875740720164736/t0(0) o3->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:332/0 lens 488/0 e 0 to 0 dl 1788845992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788845981.361654:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c26324380 with x1875740720164736 ext(0->4095) 00002000:00010000:1.0:1788845981.361659:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c26324380 00000100:00100000:1.0:1788845981.361689:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1788845981.361699:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2351:x1875740720164736:12345-192.168.206.48@tcp:3:cat.0 00000100:00100000:1.0:1788845981.361901:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2351:x1875740720164736:12345-192.168.206.48@tcp:3:cat.0 Request processed in 202us (430us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788845981.361909:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00002000:00100000:1.0:1788845981.361915:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9a0c26324380 x1875740720164736/t0(0) o3->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:332/0 lens 488/4536 e 0 to 0 dl 1788845992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788845981.361922:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c26324380 with x1875740720164736 ext(0->4095) 00002000:00010000:1.0:1788845981.361926:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c26324380 00000100:00100000:3.0:1788845982.118977:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739042816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845982.119336:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845982.119534:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739042816 00000100:00100000:2.0:1788845982.119542:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739042816 00000100:00100000:2.0:1788845982.119852:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788845982.119863:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875740739042816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845982.119897:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845982.119947:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875740739042816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845982.119954:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788845982.119985:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845982.120180:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739042816:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788845982.374293:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788845982.686263:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:0.0:1788845983.399271:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788845983.719438:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1788845983.719450:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1788845983.729840:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788845983.729888:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788845983.729968:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1788845983.729989:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a0c261ec840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788845983.729993:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1788845983.729996:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c07762100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c261ec600 00000020:00080000:0.0:1788845983.730001:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c07762c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c37c85400 00000020:00080000:2.0:1788845983.730020:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788845983.730821:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1788845984.166375:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d644e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739042944:0@lo:400:kworker.0 00000100:00100000:3.0:1788845984.166458:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845984.166609:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739042944 00000100:00100000:2.0:1788845984.166615:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739043072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845984.166617:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739042944 00000100:00100000:0.0:1788845984.166670:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788845984.166680:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739042944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845984.167762:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845984.167797:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739043712:0@lo:400:kworker.0 00000100:00100000:1.0:1788845984.167824:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739043072 00000100:00100000:2.0:1788845984.167829:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845984.167832:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739043072 00000100:00100000:2.0:1788845984.167849:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845984.167870:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739043328:0@lo:400:kworker.0 00000100:00100000:1.0:1788845984.167877:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788845984.167905:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739043072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845984.167934:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788845984.167970:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739043072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845984.167987:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788845984.168010:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845984.168032:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d645880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740739043200:0@lo:400:kworker.0 00000100:00100000:1.0:1788845984.168059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845984.168076:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739043584:0@lo:400:kworker.0 00000100:00100000:1.0:1788845984.168097:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845984.168115:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845984.168121:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739043456:0@lo:400:kworker.0 00000100:00100000:2.0:1788845984.168132:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845984.168172:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845984.168193:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788845984.168199:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a0c3eb9b100, transno 4294967304 00000100:00100000:1.0:1788845984.168202:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739043200 00000100:00100000:1.0:1788845984.168207:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739043200 00000100:00100000:2.0:1788845984.168220:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739043072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845984.168236:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739043584 00000100:00100000:1.0:1788845984.168241:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739043584 00000100:00100000:2.0:1788845984.168253:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739043712 00000100:00100000:2.0:1788845984.168258:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739043712 00000100:00100000:1.0:1788845984.168260:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739043328 00000100:00100000:1.0:1788845984.168265:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739043328 00000100:00100000:1.0:1788845984.168288:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788845984.168292:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739043456 00000100:00100000:1.0:1788845984.168297:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740739043200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845984.168298:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739043456 00000100:00100000:2.0:1788845984.168331:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788845984.168339:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739043712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845984.168354:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740739043200:12345-0@lo:400:kworker.0 Request processed in 58us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845984.168362:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788845984.168378:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788845984.168383:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739043712:12345-0@lo:400:kworker.0 Request processed in 43us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845984.168394:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788845984.168398:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739043584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845984.168414:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788845984.168423:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739043456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845984.168434:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739043584:12345-0@lo:400:kworker.0 Request processed in 38us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845984.168441:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788845984.168457:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788845984.168463:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739043456:12345-0@lo:400:kworker.0 Request processed in 40us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845984.168466:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739043328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845984.168476:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788845984.168498:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739043328:12345-0@lo:400:kworker.0 Request processed in 35us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845984.168504:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1788845984.168519:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845984.168640:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845984.168661:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788845984.168665:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a0c3eb93480, transno 4294967310 00000004:00080000:1.0:1788845984.168678:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788845984.168694:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739043456:0@lo:400:kworker.0 00000100:00100000:1.0:1788845984.168706:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d645880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740739043200:0@lo:400:kworker.0 00000100:00100000:1.0:1788845984.168716:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739043584:0@lo:400:kworker.0 00000100:00100000:1.0:1788845984.169102:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739043328:0@lo:400:kworker.0 00000100:00100000:1.0:1788845984.169115:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739043712:0@lo:400:kworker.0 00000100:00100000:0.0:1788845984.169291:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739042944:12345-0@lo:400:kworker.0 Request processed in 2611us (2830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845984.169309:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788845984.169458:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d644e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739042944:0@lo:400:kworker.0 00010000:00010000:1.0:1788845984.422464:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845984.673033:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845984.673068:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845984.673094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845984.673121:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845984.673192:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845984.673219:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720165248 00000100:00100000:2.0:1788845984.673227:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720165248 00000100:00100000:2.0:1788845984.673277:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720165120 00000100:00100000:2.0:1788845984.673289:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720165120 00000100:00100000:2.0:1788845984.673319:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:2.0:1788845984.673327:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+5:2353:x1875740720165248:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845984.673397:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+5:2353:x1875740720165248:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 70us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845984.673404:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:2.0:1788845984.673422:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:2.0:1788845984.673429:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720165120:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845984.673468:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720165120:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845984.673475:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:2.0:1788845984.673494:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720164992 00000100:00100000:2.0:1788845984.673497:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720164992 00000100:00100000:2.0:1788845984.673533:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720165376 00000100:00100000:2.0:1788845984.673537:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720165376 00000100:00100000:2.0:1788845984.673557:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:2.0:1788845984.673564:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c1841ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+13:2353:x1875740720164992:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845984.673591:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c1841ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+13:2353:x1875740720164992:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 28us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845984.673598:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:2.0:1788845984.673610:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:2.0:1788845984.673616:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2353:x1875740720165376:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788845984.673637:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2353:x1875740720165376:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845984.673643:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:1.0:1788845984.678080:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720164864 00000100:00100000:1.0:1788845984.678095:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720164864 00000100:00100000:1.0:1788845984.678199:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 282 00000100:00100000:1.0:1788845984.678209:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:2353:x1875740720164864:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845984.678290:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:2353:x1875740720164864:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 83us (5194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845984.678299:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 282 00000100:00080000:1.0:1788845984.678331:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788845984.678688:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845984.678692:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845985.292712:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845985.292751:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720165504 00000100:00100000:2.0:1788845985.292759:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720165504 00000100:00100000:2.0:1788845985.292809:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00100000:2.0:1788845985.292819:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+13:10222:x1875740720165504:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788845985.292907:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+13:10222:x1875740720165504:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 Request processed in 89us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845985.292914:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00100000:1.0:1788845985.299409:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845985.299494:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720165760 00000100:00100000:2.0:1788845985.299504:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720165760 00000100:00100000:2.0:1788845985.299625:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:2.0:1788845985.299638:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+13:10222:x1875740720165760:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788845985.299990:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+14:10222:x1875740720165760:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 354us (587us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788845985.299999:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00010000:00010000:0.0:1788845985.446350:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845985.659812:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845985.660080:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720165888 00000100:00100000:3.0:1788845985.660090:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720165888 00000100:00100000:3.0:1788845985.660148:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 136 00000100:00100000:3.0:1788845985.660176:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8450d7e-d658-40b4-8296-b4731edf9929+5:11029:x1875740720165888:12345-192.168.206.48@tcp:101:lsof.0 00010000:00010000:3.0:1788845985.660196:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845985.660213:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f84b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ced2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845985.660307:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f852 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845985.660320:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f852 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845985.660331:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f852 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845985.660371:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788845985.660374:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845985.660545:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f852 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845985.660572:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57200/0x1345bc80c773f84b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ced2 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845985.660590:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f852 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ced2 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845985.660597:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:3.0:1788845985.660720:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788845985.660726:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c12f57600, rc 0) 00000100:00100000:3.0:1788845985.660815:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8450d7e-d658-40b4-8296-b4731edf9929+6:11029:x1875740720165888:12345-192.168.206.48@tcp:101:lsof.0 Request processed in 640us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845985.660823:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 136 00010000:00010000:0.0:1788845986.470357:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845987.240281:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739043840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845987.240348:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845987.240480:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739043840 00000100:00100000:2.0:1788845987.240488:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739043840 00000100:00100000:2.0:1788845987.240562:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788845987.240572:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739043840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845987.240602:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845987.240646:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739043840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845987.240654:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788845987.240767:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845987.240803:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739043840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788845987.494653:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788845987.816457:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788845987.816466:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788845987.816727:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1788845987.816734:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788845988.519438:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788845988.858000:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788845988.858013:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788845988.858045:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788845988.858054:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:3.0:1788845988.886654:0:12357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:39:47 (1788845987) 00000100:00100000:3.0:1788845989.286339:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739043968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845989.286404:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845989.287341:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740739044352:0@lo:400:kworker.0 00000100:00100000:1.0:1788845989.287377:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845989.287425:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788845989.287431:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d645880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739044224:0@lo:400:kworker.0 00000100:00100000:1.0:1788845989.287453:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845989.287470:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739044736:0@lo:400:kworker.0 00000100:00100000:1.0:1788845989.287495:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845989.287526:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739044736 00000100:00100000:1.0:1788845989.287532:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739044736 00000100:00100000:1.0:1788845989.287581:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788845989.287590:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c2060aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739044736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845989.287639:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c2060aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739044736:12345-0@lo:400:kworker.0 Request processed in 51us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845989.287645:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788845989.287678:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845989.287713:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739044736:0@lo:400:kworker.0 00000100:00100000:1.0:1788845989.287750:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739044352 00000100:00100000:1.0:1788845989.287754:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739044352 00000100:00100000:1.0:1788845989.287779:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739044224 00000100:00100000:1.0:1788845989.287781:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739044224 00000100:00100000:1.0:1788845989.287798:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788845989.287804:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740739044352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845989.287837:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740739044352:12345-0@lo:400:kworker.0 Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845989.287843:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788845989.287854:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788845989.287861:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739044224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845989.287885:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739044224:12345-0@lo:400:kworker.0 Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845989.287892:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1788845989.287916:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845989.287924:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739044096:0@lo:400:kworker.0 00000100:00100000:1.0:1788845989.287935:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d645880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739044224:0@lo:400:kworker.0 00000100:00100000:1.0:1788845989.287948:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740739044352:0@lo:400:kworker.0 00000100:00100000:0.0:1788845989.287978:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845989.288003:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739044608:0@lo:400:kworker.0 00000100:00100000:0.0:1788845989.288024:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845989.288045:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845989.288051:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d644e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739044480:0@lo:400:kworker.0 00000100:00100000:1.0:1788845989.288060:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739044096 00000100:00100000:1.0:1788845989.288065:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739044096 00000100:00100000:0.0:1788845989.288074:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845989.288096:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788845989.288105:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739044096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845989.288107:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739044480 00000100:00100000:0.0:1788845989.288112:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739044480 00000100:00100000:1.0:1788845989.288147:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739044096:12345-0@lo:400:kworker.0 Request processed in 44us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845989.288173:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788845989.288181:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788845989.288186:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739044480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845989.288241:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739044480:12345-0@lo:400:kworker.0 Request processed in 60us (166us total) trans 0 rc 0/0 00000100:00080000:1.0:1788845989.288243:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845989.288251:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788845989.288253:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739044608 00000100:00100000:1.0:1788845989.288257:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739044608 00000100:00100000:1.0:1788845989.288287:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788845989.288293:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739044608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845989.288325:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739044608:12345-0@lo:400:kworker.0 Request processed in 33us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845989.288332:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1788845989.288358:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845989.288384:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d644e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739044480:0@lo:400:kworker.0 00000100:00100000:0.0:1788845989.288396:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739044096:0@lo:400:kworker.0 00000100:00100000:0.0:1788845989.288405:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739044608:0@lo:400:kworker.0 00000100:00100000:2.0:1788845989.290017:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739043968 00000100:00100000:2.0:1788845989.290029:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739043968 00000100:00100000:2.0:1788845989.290122:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788845989.290131:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739043968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845989.290185:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845989.290256:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739043968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (3852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845989.290263:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788845989.290345:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d7a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739043968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788845989.542316:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845989.793099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845989.793142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845989.793202:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845989.793226:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845989.793250:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845989.793276:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720166528 00000100:00100000:3.0:1788845989.793285:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720166528 00000100:00100000:3.0:1788845989.793349:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720166144 00000100:00100000:3.0:1788845989.793353:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720166144 00000100:00100000:3.0:1788845989.793375:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:3.0:1788845989.793384:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8450d7e-d658-40b4-8296-b4731edf9929+6:2352:x1875740720166528:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845989.793453:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8450d7e-d658-40b4-8296-b4731edf9929+6:2352:x1875740720166528:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 69us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845989.793460:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:3.0:1788845989.793476:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:3.0:1788845989.793483:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+13:2352:x1875740720166144:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845989.793513:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+13:2352:x1875740720166144:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845989.793519:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00080000:3.0:1788845989.793626:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845989.793637:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720166272 00000100:00100000:3.0:1788845989.793641:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720166272 00000100:00100000:3.0:1788845989.793731:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720166400 00000100:00100000:3.0:1788845989.793735:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720166400 00000100:00100000:3.0:1788845989.793757:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:3.0:1788845989.793764:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720166272:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845989.793798:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720166272:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 34us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845989.793804:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:3.0:1788845989.793816:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:3.0:1788845989.793823:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720166400:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845989.793845:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720166400:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 23us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845989.793851:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00080000:3.0:1788845989.793924:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845989.793928:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845989.794175:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720166016 00000100:00100000:1.0:1788845989.794180:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720166016 00000100:00100000:1.0:1788845989.794216:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 284 00000100:00100000:1.0:1788845989.794223:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720166016:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845989.794256:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720166016:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 34us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845989.794262:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 284 00000100:00100000:3.0:1788845990.007148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845990.007465:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720166784 00000100:00100000:1.0:1788845990.007475:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720166784 00000100:00100000:1.0:1788845990.007531:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 137 00000100:00100000:1.0:1788845990.007541:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+13:11293:x1875740720166784:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845990.007559:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845990.007578:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773f859 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ced9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.007646:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f860 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.007661:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f860 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.007686:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f860 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.007702:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f867 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.007708:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f867 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.007714:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f867 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.007972:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773f86e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.007981:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773f86e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.007988:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773f86e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845990.007998:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788845990.008147:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f860 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008184:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f860 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008191:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f860 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008197:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845990.008208:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f860 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008216:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f860 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008227:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a0c04c4fd00) 00010000:00010000:1.0:1788845990.008231:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845990.008235:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f860 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008241:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f860 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008253:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f867 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008259:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f867 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008264:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f867 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008269:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845990.008272:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f867 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008278:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f867 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008285:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a0c10382100) 00010000:00010000:1.0:1788845990.008288:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845990.008298:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f867 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008304:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773f867 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008670:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773f859 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ced9 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008685:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773f86e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ced9 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845990.008693:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f200) 00010000:00010000:1.0:1788845990.008695:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845990.008698:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01a00, rc 0) 00000100:00100000:1.0:1788845990.008772:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+15:11293:x1875740720166784:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 1233us (1634us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788845990.008780:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 137 00000100:00100000:3.0:1788845990.018407:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845990.018813:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845990.018898:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720167040 00000100:00100000:2.0:1788845990.018908:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720167040 00000100:00100000:2.0:1788845990.018986:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:2.0:1788845990.018995:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+15:2351:x1875740720167040:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845990.019009:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845990.019031:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773f86e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ced9 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845990.019049:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f200) 00010000:00010000:2.0:1788845990.019054:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845990.019106:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+14:2351:x1875740720167040:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 111us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845990.019122:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1788845990.019423:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720166912 00000100:00100000:1.0:1788845990.019429:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720166912 00000100:00100000:1.0:1788845990.019467:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 138 00000100:00100000:1.0:1788845990.019475:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d9ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+14:11293:x1875740720166912:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788845990.019562:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d9ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+14:11293:x1875740720166912:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 88us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845990.019569:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 138 00010000:00010000:1.0:1788845990.566441:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788845990.887984:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845990.888000:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845990.888039:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788845990.888046:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788845991.590342:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845991.873717:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845991.878047:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720167168 00000100:00100000:1.0:1788845991.878060:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720167168 00000100:00100000:1.0:1788845991.878132:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 139 00000100:00100000:1.0:1788845991.878142:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+14:11336:x1875740720167168:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788845991.878184:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845991.878203:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f87c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cee0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878260:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f883 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878275:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f883 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878288:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f883 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878301:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f88a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878307:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878325:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878562:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f883 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878571:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f883 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878577:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f883 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878592:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845991.878597:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f883 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878604:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f883 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878617:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:1.0:1788845991.878620:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845991.878625:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878631:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878642:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878647:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f88a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878654:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f88a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878659:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845991.878661:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f88a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878667:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f88a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878686:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a0c10382200) 00010000:00010000:1.0:1788845991.878688:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845991.878691:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f88a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878697:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f88a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878727:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f87c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cee0 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878736:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:1.0:1788845991.878738:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845991.878742:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773f87c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cee0 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.878750:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00200, rc 0) 00000100:00100000:1.0:1788845991.878815:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+14:11336:x1875740720167168:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 674us (5106us total) trans 0 rc 301/301 00000100:00100000:1.0:1788845991.878822:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 139 00000100:00080000:1.0:1788845991.878846:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845991.887181:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845991.888526:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720167424 00000100:00100000:0.0:1788845991.888538:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720167424 00000100:00100000:0.0:1788845991.888598:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00100000:0.0:1788845991.888607:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+14:11336:x1875740720167424:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:0.0:1788845991.888652:0:7134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845991.888675:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773f1fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd19 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.888691:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:0.0:1788845991.888695:0:7134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845991.888854:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.888867:0:7134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f852 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ced2 expref: 5 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.888876:0:7134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.888902:0:7134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f852 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ced2 expref: 5 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.888914:0:7134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f852 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ced2 expref: 5 pid: 5847 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845991.888953:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c206d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739044864:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845991.889029:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845991.892510:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c206d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739044864:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845991.892537:0:7134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845991.897673:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845991.897841:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720167552 00000100:00100000:0.0:1788845991.897849:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720167552 00010000:00010000:0.0:1788845991.897902:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f852 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ced2 expref: 6 pid: 5847 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845991.897946:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:0.0:1788845991.897957:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8450d7e-d658-40b4-8296-b4731edf9929+6:2354:x1875740720167552:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845991.897971:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845991.897986:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f852 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ced2 expref: 6 pid: 5847 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.898000:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f852 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ced2 expref: 6 pid: 5847 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.898021:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f57600/0x1345bc80c773f852 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ced2 expref: 6 pid: 5847 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.898034:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:0.0:1788845991.898040:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.898049:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.898067:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.898095:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845991.898144:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2354:x1875740720167552:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 189us (480us total) trans 0 rc 0/0 00000100:00080000:1.0:1788845991.898319:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845991.898635:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00010000:00010000:0.0:1788845991.898747:0:7134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.898756:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.898779:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f898 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.898790:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f898 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.898798:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f898 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845991.900521:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788845991.900535:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.903054:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.903076:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.903097:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845991.903102:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.903111:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.903129:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382e00) 00010000:00010000:0.0:1788845991.903132:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845991.903136:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845991.903142:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f891 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788845991.903181:0:7134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9e3a33d reply state 000000002b61c9b7 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f898 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845991.903190:0:7134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845991.903290:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+15:11336:x1875740720167424:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 14679us (16135us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788845991.903298:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 140 00010000:00010000:1.0:1788845991.906073:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f898 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.906089:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f898 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.906097:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f898 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.906111:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcfe00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845991.906115:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f898 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.906122:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f898 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.906137:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a0c11677100) 00010000:00010000:1.0:1788845991.906140:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845991.906144:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f898 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.906150:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f898 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845991.992641:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845991.993656:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720167680 00000100:00100000:1.0:1788845991.993667:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720167680 00000100:00100000:1.0:1788845991.993727:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 141 00000100:00100000:1.0:1788845991.993736:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c206d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+14:11344:x1875740720167680:12345-192.168.206.48@tcp:101:lctl.0 00010000:00010000:1.0:1788845991.993757:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845991.993777:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f89f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cee7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.993838:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f8a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.993852:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.993879:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845991.993910:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788845991.993913:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845991.993955:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.993981:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773f89f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cee7 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.993998:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cee7 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845991.994006:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382100) 00010000:00010000:1.0:1788845991.994009:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845991.994013:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01e00, rc 0) 00000100:00100000:1.0:1788845991.994123:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c206d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+15:11344:x1875740720167680:12345-192.168.206.48@tcp:101:lctl.0 Request processed in 388us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845991.994131:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 141 00000100:00100000:2.0:1788845992.063544:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845992.063606:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720167808 00000100:00100000:0.0:1788845992.063617:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720167808 00000100:00100000:0.0:1788845992.063676:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 142 00000100:00100000:0.0:1788845992.063685:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+15:11350:x1875740720167808:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788845992.063704:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845992.063722:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f8ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305ceee expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.063791:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f8b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.063806:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f8b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.063818:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f8b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.063831:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f8bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.063838:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f8bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.063845:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f8bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.063929:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f8c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.063950:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.063958:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845992.064238:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788845992.064242:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845992.064261:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064284:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f8b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064290:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f8b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064296:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f8b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064301:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845992.064305:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f8b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064312:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f8b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064324:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382100) 00010000:00010000:0.0:1788845992.064332:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845992.064626:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f8b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064635:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f8b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064650:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f8bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064657:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f8bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064662:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f8bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064673:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcfa00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845992.064677:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f8bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064682:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f8bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064692:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a0c11677c00) 00010000:00010000:0.0:1788845992.064694:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845992.064697:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f8bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064703:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f8bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064735:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f8ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceee expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064748:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceee expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.064754:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:0.0:1788845992.064756:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788845992.064758:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcfe00, rc 0) 00000100:00100000:0.0:1788845992.064885:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+16:11350:x1875740720167808:12345-192.168.206.48@tcp:101:bash.0 Request processed in 1199us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845992.064893:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 142 00000100:00100000:2.0:1788845992.070052:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845992.070148:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720168064 00000100:00100000:3.0:1788845992.070187:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720168064 00000100:00100000:3.0:1788845992.070233:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 143 00000100:00100000:3.0:1788845992.070241:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3da24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+16:11350:x1875740720168064:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1788845992.070261:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845992.070279:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f8c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cef5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.070385:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f8d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.070410:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f8d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.070433:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f8d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.070448:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f8d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.070455:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.070461:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788845992.070922:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788845992.071096:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f8de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.071107:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f8de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.071114:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f8de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.071144:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f8d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.071185:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f8d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.071193:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f8d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.071205:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845992.071209:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f8d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.071216:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f8d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.071228:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:3.0:1788845992.071231:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845992.071235:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f8d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.071241:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f8d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845992.071253:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002964bed reply state 00000000b5002f6e transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845992.071260:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788845992.071289:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f8c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cef5 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.071304:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f8de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cef5 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.071311:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164c00) 00010000:00010000:3.0:1788845992.071313:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845992.071316:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474200, rc 0) 00000100:00100000:3.0:1788845992.071385:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3da24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+19:11350:x1875740720168064:12345-192.168.206.48@tcp:101:bash.0 Request processed in 1144us (1341us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788845992.071399:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 143 00010000:00010000:0.0:1788845992.073672:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.073700:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f8d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.073707:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f8d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.073713:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845992.073717:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f8d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.073725:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f8d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.073740:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c31164100) 00010000:00010000:0.0:1788845992.073744:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845992.073748:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f8d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.073754:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f8d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845992.077714:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845992.077983:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720168192 00000100:00100000:0.0:1788845992.077993:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720168192 00000100:00100000:0.0:1788845992.078064:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:0.0:1788845992.078077:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+5:2354:x1875740720168192:12345-192.168.206.48@tcp:101:bash.0 00000100:00080000:1.0:1788845992.078088:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788845992.078095:0:8094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845992.078116:0:8094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c259fe6/0x1345bc80c773f8ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cefc expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788845992.078173:0:8094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788845992.078191:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=324s v=(0 0) 00010000:00010000:0.0:1788845992.078195:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845992.078205:0:8094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c259fe6/0x1345bc80c773f8ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cefc expref: 6 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.078224:0:8094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c259fe6/0x1345bc80c773f8ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cefc expref: 6 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.078236:0:8094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce800, rc 0) 00000100:00100000:0.0:1788845992.078297:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:2354:x1875740720168192:12345-192.168.206.48@tcp:101:bash.0 Request processed in 225us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845992.078305:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:3.0:1788845992.084315:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845992.085291:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720168320 00000100:00100000:1.0:1788845992.085304:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720168320 00000100:00100000:1.0:1788845992.085404:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:1.0:1788845992.085416:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:11350:x1875740720168320:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788845992.085435:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845992.085453:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf03 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.085495:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c259fe6/0x1345bc80c773f8ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cefc expref: 7 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.085504:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845992.085508:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845992.085513:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.085547:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c259fe6/0x1345bc80c773f8ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cefc expref: 7 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.085560:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c259fe6/0x1345bc80c773f8ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cefc expref: 7 pid: 8094 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845992.085574:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d645500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875740739044992:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788845992.085715:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c351bdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788845992.088596:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d645500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875740739044992:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845992.088840:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.088864:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00600, rc 0) 00000100:00100000:3.0:1788845992.089851:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:11350:x1875740720168320:12345-192.168.206.48@tcp:101:bash.0 Request processed in 4431us (5539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845992.089862:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:2.0:1788845992.090577:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845992.090670:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720168448 00000100:00100000:1.0:1788845992.090679:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720168448 00010000:00010000:1.0:1788845992.090715:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c259fe6/0x1345bc80c773f8ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cefc expref: 7 pid: 8094 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845992.090837:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:1.0:1788845992.090847:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2353:x1875740720168448:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845992.090860:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845992.090894:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c259fe6/0x1345bc80c773f8ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cefc expref: 7 pid: 8094 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.090908:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c259fe6/0x1345bc80c773f8ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cefc expref: 7 pid: 8094 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.090931:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c259fe6/0x1345bc80c773f8ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cefc expref: 7 pid: 8094 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.090958:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845992.090962:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845992.090970:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.090980:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.091017:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845992.091031:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d646300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5832:1875740739045120:192.168.206.48@tcp:105: 00000100:00100000:1.0:1788845992.091108:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c351bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845992.093076:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d646300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5832:1875740739045120:192.168.206.48@tcp:105: 00010000:00010000:1.0:1788845992.093101:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845992.093176:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720168448:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 2307us (2579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845992.093200:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:2.0:1788845992.095360:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845992.095586:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720168704 00000100:00100000:1.0:1788845992.095595:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720168704 00000100:00100000:1.0:1788845992.095688:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:1.0:1788845992.095699:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+18:11350:x1875740720168704:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:1.0:1788845992.096017:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+19:11350:x1875740720168704:12345-192.168.206.48@tcp:35:bash.0 Request processed in 318us (662us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788845992.096025:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:2.0:1788845992.180918:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845992.181002:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720168960 00000100:00100000:0.0:1788845992.181010:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720168960 00000100:00100000:0.0:1788845992.181062:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 144 00000100:00100000:0.0:1788845992.181077:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+19:11360:x1875740720168960:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845992.181098:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845992.181115:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f8fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf0a expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845992.181209:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788845992.181305:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f8fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf0a expref: 21 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.181345:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382100) 00010000:00010000:0.0:1788845992.181348:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845992.181354:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f8fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf0a expref: 21 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.181367:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce200, rc 0) 00000100:00100000:0.0:1788845992.181419:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+20:11360:x1875740720168960:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 342us (508us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788845992.181426:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 144 00000100:00100000:0.0:1788845992.188752:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845992.189577:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720169216 00000100:00100000:2.0:1788845992.189587:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720169216 00000100:00100000:2.0:1788845992.189638:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:2.0:1788845992.189647:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+20:11360:x1875740720169216:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788845992.189865:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+21:11360:x1875740720169216:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 217us (1120us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788845992.189873:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:1.0:1788845992.280442:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845992.280509:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720169344 00000100:00100000:3.0:1788845992.280520:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720169344 00000100:00100000:3.0:1788845992.280589:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 145 00000100:00100000:3.0:1788845992.280599:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+21:11366:x1875740720169344:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845992.280623:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845992.280642:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf11 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.280707:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f90f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.280721:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f90f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.280733:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f90f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845992.280783:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788845992.280786:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845992.280803:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f90f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.280828:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf11 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.280848:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f90f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf11 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.280857:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:3.0:1788845992.280859:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788845992.280863:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475800, rc 0) 00000100:00100000:3.0:1788845992.281324:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+22:11366:x1875740720169344:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 724us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845992.281333:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 145 00000100:00100000:3.0:1788845992.291322:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845992.291414:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720169600 00000100:00100000:0.0:1788845992.291423:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720169600 00000100:00100000:0.0:1788845992.291489:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 146 00000100:00100000:0.0:1788845992.291499:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+22:11366:x1875740720169600:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845992.291518:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845992.291546:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f916 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf18 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.291792:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f91d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.291807:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f91d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.291818:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f91d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845992.291845:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788845992.291975:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f916 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf18 expref: 25 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.291993:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f91d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf18 expref: 24 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.292003:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164c00) 00010000:00010000:0.0:1788845992.292005:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845992.292009:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce600, rc 0) 00000100:00100000:0.0:1788845992.292191:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+24:11366:x1875740720169600:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 693us (877us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788845992.292199:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 146 00000100:00100000:0.0:1788845992.296959:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845992.297045:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720169984 00000100:00100000:2.0:1788845992.297055:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720169984 00000100:00100000:2.0:1788845992.297120:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:2.0:1788845992.297130:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+24:2351:x1875740720169984:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845992.297147:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845992.297211:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f91d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf18 expref: 24 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.297231:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164c00) 00010000:00010000:2.0:1788845992.297250:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845992.297308:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+23:2351:x1875740720169984:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 180us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845992.297315:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:1.0:1788845992.302297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845992.302387:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720169856 00000100:00100000:3.0:1788845992.302397:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720169856 00000100:00100000:3.0:1788845992.302460:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 147 00000100:00100000:3.0:1788845992.302470:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+23:11366:x1875740720169856:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845992.302501:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845992.302520:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f92b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.302758:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f932 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.302784:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.302801:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845992.302813:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788845992.302927:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f92b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf1f expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.302957:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f932 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf1f expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.302965:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164c00) 00010000:00010000:3.0:1788845992.302969:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788845992.302972:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474a00, rc 0) 00000100:00100000:3.0:1788845992.303089:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+25:11366:x1875740720169856:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 619us (801us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788845992.303097:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 147 00000100:00100000:3.0:1788845992.315390:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845992.315585:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720170112 00000100:00100000:0.0:1788845992.315595:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720170112 00000100:00100000:0.0:1788845992.315649:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:0.0:1788845992.315659:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2354:x1875740720170112:12345-192.168.206.48@tcp:1:lfs.0 00010000:00010000:0.0:1788845992.315698:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.315719:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.315728:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845992.315732:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788845992.315749:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.315786:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.315800:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 6 pid: 6690 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845992.315813:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1875740739045248:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845992.315953:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788845992.318643:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845992.318724:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720170240 00000100:00100000:1.0:1788845992.318733:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720170240 00002000:00100000:1.0:1788845992.318778:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a0c3eb4d180 x1875740720170240/t0(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:343/0 lens 504/0 e 0 to 0 dl 1788846003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788845992.318789:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3eb4d180 with x1875740720170240 ext(0->12) 00010000:00010000:1.0:1788845992.318797:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 7 pid: 6690 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.318813:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 7 pid: 6690 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788845992.318821:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a0c3eb4d180 00000100:00100000:1.0:1788845992.318851:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1788845992.318861:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2353:x1875740720170240:12345-192.168.206.48@tcp:4:lfs.0 00000100:00100000:1.0:1788845992.319352:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4592a189-21d8-449a-9335-07bfe0dc7877+9:2353:x1875740720170240:12345-192.168.206.48@tcp:4:lfs.0 Request processed in 492us (716us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788845992.319366:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00002000:00100000:1.0:1788845992.319374:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a0c3eb4d180 x1875740720170240/t4294967305(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:343/0 lens 504/448 e 0 to 0 dl 1788846003 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788845992.319382:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3eb4d180 with x1875740720170240 ext(0->12) 00010000:00010000:1.0:1788845992.319388:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 9 pid: 6690 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.319399:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 9 pid: 6690 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788845992.319406:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a0c3eb4d180 00000100:00100000:2.0:1788845992.321111:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1875740739045248:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845992.321142:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845992.324271:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845992.324353:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720170368 00000100:00100000:3.0:1788845992.324363:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720170368 00010000:00010000:3.0:1788845992.324401:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 9 pid: 6690 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845992.324440:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:3.0:1788845992.324449:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+9:2353:x1875740720170368:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845992.324476:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788845992.324505:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788845992.324508:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788845991 00002000:00010000:3.0:1788845992.324510:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788845992 00002000:00010000:3.0:1788845992.324512:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788845991 00010000:00010000:3.0:1788845992.324518:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 9 pid: 6690 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.324531:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 9 pid: 6690 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.324554:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c773f8f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf03 expref: 9 pid: 6690 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.324572:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845992.324576:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845992.324581:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.324590:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.324622:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845992.324677:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+8:2353:x1875740720170368:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 229us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845992.324685:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00010000:00010000:2.0:1788845992.325041:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.325052:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.325077:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.325086:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.325095:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.325101:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:2.0:1788845992.325105:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.325126:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.325140:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.325148:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a65092d3/0x1345bc80c773f940 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845992.325250:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+7:2354:x1875740720170112:12345-192.168.206.48@tcp:1:lfs.0 Request processed in 9592us (9869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845992.325259:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:0.0:1788845992.328984:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845992.329075:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720170624 00000100:00100000:2.0:1788845992.329095:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720170624 00000100:00100000:2.0:1788845992.329193:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:2.0:1788845992.329203:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08dc2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+25:11366:x1875740720170624:12345-192.168.206.48@tcp:35:lfs.0 00000004:00010000:2.0:1788845992.329268:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f932 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf1f expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845992.329477:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788845992.329517:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788845992.329984:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788845992.330031:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.330047:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f8de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cef5 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.330062:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.330092:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f8de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cef5 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.330107:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f8de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cef5 expref: 29 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845992.330121:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875740739045376:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845992.330215:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845992.333723:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845992.333827:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875740739045376:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845992.333853:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845992.333921:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720170752 00000100:00100000:1.0:1788845992.333929:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720170752 00010000:00010000:1.0:1788845992.333982:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f8de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cef5 expref: 30 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845992.334019:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:1.0:1788845992.334027:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c02d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+30:2354:x1875740720170752:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845992.334040:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845992.334046:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f8de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cef5 expref: 30 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.334057:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f8de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cef5 expref: 30 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.334078:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f8de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cef5 expref: 30 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.334108:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164c00) 00010000:00010000:1.0:1788845992.334113:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.334122:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.334130:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845992.334189:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845992.334236:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c02d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+29:2354:x1875740720170752:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 209us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845992.334243:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00010000:00010000:2.0:1788845992.334339:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.334348:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845992.334453:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788845992.334638:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788845992.334731:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875740739045504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788845992.334768:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845992.334801:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200ae9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845992.335237:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739045504 00000100:00100000:1.0:1788845992.335244:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739045504 00000100:00100000:1.0:1788845992.335293:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788845992.335302:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1875740739045504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788845992.335365:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1875740739045504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 64us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845992.335371:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788845992.335522:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845992.335656:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875740739045504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788845992.336138:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788845992.336806:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875740739045632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788845992.336847:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845992.336955:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200aeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845992.337324:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739045632 00000100:00100000:1.0:1788845992.337331:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739045632 00000100:00100000:1.0:1788845992.337408:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788845992.337417:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1875740739045632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788845992.337604:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1875740739045632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 188us (755us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788845992.337620:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788845992.337682:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875740739045632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788845992.337731:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788845992.337765:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.337776:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.337784:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.337789:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845992.337793:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.337800:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.337815:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164c00) 00010000:00010000:2.0:1788845992.337818:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788845992.337822:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.337828:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773f947 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788845992.338013:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788845992.338107:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788845992.338118:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 324554963686ns, next at 325554961846ns, rc = 0 00000001:00080000:2.0:1788845992.338124:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788845992.338176:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164c00) 00010000:00010000:2.0:1788845992.338179:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788845992.338185:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f932 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf1f expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845992.338561:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08dc2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+32:11366:x1875740720170624:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 9359us (9593us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788845992.338570:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00000020:00080000:2.0:1788845992.338574:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788845992.341107:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845992.341298:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720170880 00000100:00100000:0.0:1788845992.341308:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720170880 00000100:00100000:0.0:1788845992.341363:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 148 00000100:00100000:0.0:1788845992.341372:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+32:11366:x1875740720170880:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845992.341393:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845992.341412:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f94e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf26 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.341462:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f94e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf26 expref: 33 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.341475:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f94e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf26 expref: 33 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.341524:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:0.0:1788845992.341527:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788845992.341530:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce200, rc 0) 00000100:00100000:0.0:1788845992.341584:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+33:11366:x1875740720170880:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 213us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845992.341591:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 148 00000100:00100000:3.0:1788845992.343818:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845992.344054:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720171136 00000100:00100000:0.0:1788845992.344062:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720171136 00000100:00100000:0.0:1788845992.344124:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:0.0:1788845992.344134:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+33:11366:x1875740720171136:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788845992.344445:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+34:11366:x1875740720171136:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 311us (633us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788845992.344452:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:1.0:1788845992.358419:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cfad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739045760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845992.358491:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845992.358693:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739045760 00000100:00100000:0.0:1788845992.358701:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739045760 00000100:00100000:0.0:1788845992.358766:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788845992.358778:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739045760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845992.358806:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788845992.358855:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739045760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845992.358863:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788845992.358960:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845992.359030:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cfad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739045760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845992.428294:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845992.428733:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720171392 00000100:00100000:3.0:1788845992.428743:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720171392 00000100:00100000:3.0:1788845992.428809:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 149 00000100:00100000:3.0:1788845992.428819:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+34:11376:x1875740720171392:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845992.428842:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845992.428862:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f955 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845992.428950:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788845992.429069:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f955 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf2d expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.429084:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382100) 00010000:00010000:3.0:1788845992.429087:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788845992.429091:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f955 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf2d expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.429103:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475a00, rc 0) 00000100:00100000:3.0:1788845992.429448:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+35:11376:x1875740720171392:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 629us (1161us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788845992.429455:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 149 00000100:00100000:3.0:1788845992.432395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845992.432481:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720171520 00000100:00100000:0.0:1788845992.432501:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720171520 00000100:00100000:0.0:1788845992.432556:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 150 00000100:00100000:0.0:1788845992.432565:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+35:11376:x1875740720171520:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:0.0:1788845992.432737:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f963 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.432754:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f963 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.432764:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f963 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.432780:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f96a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.432787:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f96a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.432804:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f96a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.432879:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f971 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.432888:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.432895:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788845992.432931:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.432955:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f963 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433104:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f963 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433301:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f963 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433307:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845992.433311:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f963 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433317:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f963 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433329:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:0.0:1788845992.433331:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845992.433335:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f963 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433341:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f963 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433355:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f96a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433361:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f96a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433367:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f96a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433372:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcfa00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845992.433383:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f96a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433389:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f96a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433398:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c11677200) 00010000:00010000:0.0:1788845992.433401:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845992.433404:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f96a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433409:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773f96a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433423:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433429:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f971 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433435:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433440:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845992.433443:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433449:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f971 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433456:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:0.0:1788845992.433458:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845992.433467:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f971 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.433474:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773f971 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845992.433601:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+35:11376:x1875740720171520:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 1034us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845992.433609:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 150 00000100:00100000:0.0:1788845992.442450:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845992.442638:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720171776 00000100:00100000:3.0:1788845992.442647:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720171776 00000100:00100000:3.0:1788845992.442698:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:3.0:1788845992.442719:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+35:11376:x1875740720171776:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1788845992.442947:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+36:11376:x1875740720171776:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 229us (504us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788845992.442954:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:1.0:1788845992.479593:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845992.479805:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720172032 00000100:00100000:3.0:1788845992.479814:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720172032 00000100:00100000:3.0:1788845992.479869:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 151 00000100:00100000:3.0:1788845992.479878:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+36:11379:x1875740720172032:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845992.479899:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845992.479918:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f978 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.479997:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f97f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480011:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f97f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480022:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f97f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480037:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f986 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480044:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480050:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480233:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f98d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480242:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f98d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480249:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f98d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845992.480258:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788845992.480346:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f97f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480354:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f97f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480365:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f97f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480371:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845992.480375:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f97f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480382:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f97f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480394:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:3.0:1788845992.480397:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845992.480401:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f97f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480417:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773f97f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480439:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480448:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f986 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480453:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480459:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845992.480462:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480468:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f986 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480476:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c31164b00) 00010000:00010000:3.0:1788845992.480479:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845992.480482:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f986 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480487:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773f986 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480527:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f978 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf34 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480540:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f98d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf34 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.480554:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:3.0:1788845992.480557:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845992.480559:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474200, rc 0) 00000100:00100000:3.0:1788845992.480849:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+38:11379:x1875740720172032:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 733us (1025us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788845992.480859:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 151 00000100:00100000:2.0:1788845992.483995:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845992.484255:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720172160 00000100:00100000:3.0:1788845992.484263:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720172160 00000100:00100000:3.0:1788845992.484308:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 152 00000100:00100000:3.0:1788845992.484317:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cfad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+38:11379:x1875740720172160:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:3.0:1788845992.484381:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f99b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.484396:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.484407:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.484437:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.484444:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f99b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.484450:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f99b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.484456:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845992.484473:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f99b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.484481:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f99b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.484493:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:3.0:1788845992.484496:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788845992.484500:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f99b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.484507:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f99b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845992.484643:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cfad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+38:11379:x1875740720172160:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 327us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845992.484651:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 152 00000100:00100000:0.0:1788845992.491629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845992.491758:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720172416 00000100:00100000:3.0:1788845992.491767:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720172416 00000100:00100000:3.0:1788845992.491830:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:3.0:1788845992.491840:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+38:11379:x1875740720172416:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1788845992.492078:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+39:11379:x1875740720172416:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 238us (468us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788845992.492086:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00010000:00010000:0.0:1788845992.616922:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845992.792761:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845992.792977:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720172672 00000100:00100000:3.0:1788845992.792986:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720172672 00000100:00100000:3.0:1788845992.793044:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 153 00000100:00100000:3.0:1788845992.793054:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+39:11410:x1875740720172672:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:3.0:1788845992.793076:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845992.793109:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f9a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf3b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.793225:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.793240:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.793252:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845992.793263:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788845992.795522:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773f9a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf3b expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.795547:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf3b expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.795555:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:3.0:1788845992.795558:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845992.795561:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475a00, rc 0) 00000100:00100000:3.0:1788845992.795697:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+41:11410:x1875740720172672:12345-192.168.206.48@tcp:101:cat.0 Request processed in 2642us (2945us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788845992.795772:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 153 00000100:00100000:2.0:1788845992.802565:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845992.802648:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845992.802896:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720172800 00000100:00100000:3.0:1788845992.802905:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720172800 00000100:00100000:0.0:1788845992.803044:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720173056 00000100:00100000:0.0:1788845992.803049:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720173056 00000100:00100000:0.0:1788845992.803099:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:0.0:1788845992.803120:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+42:11410:x1875740720173056:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:0.0:1788845992.803421:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+43:11410:x1875740720173056:12345-192.168.206.48@tcp:35:cat.0 Request processed in 312us (771us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788845992.803429:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:3.0:1788845992.803630:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1788845992.803644:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+42:2353:x1875740720172800:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845992.803670:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845992.803696:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf3b expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.803724:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:3.0:1788845992.803729:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845992.803763:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+41:2353:x1875740720172800:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 125us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845992.803769:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:1.0:1788845992.878518:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845992.878618:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720173312 00000100:00100000:0.0:1788845992.878628:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720173312 00000100:00100000:0.0:1788845992.878692:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 154 00000100:00100000:0.0:1788845992.878702:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+41:11416:x1875740720173312:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:0.0:1788845992.878726:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845992.878729:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788845992.879978:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773f90f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf11 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.880114:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:0.0:1788845992.880119:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845992.880134:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f9b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf42 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.881981:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.882505:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f98d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf34 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.882516:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.882554:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f98d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf34 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845992.882571:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f98d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf34 expref: 41 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845992.882591:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739045888:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845992.882800:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845992.886673:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf6a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739045888:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788845992.886704:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845992.887203:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845992.887661:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720173440 00000100:00100000:3.0:1788845992.887669:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720173440 00010000:00010000:3.0:1788845992.887707:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f98d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf34 expref: 42 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845992.887788:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:3.0:1788845992.887799:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+42:2354:x1875740720173440:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845992.887813:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845992.887820:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f98d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf34 expref: 42 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.887846:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f98d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf34 expref: 42 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.887867:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f98d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf34 expref: 42 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.887892:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:3.0:1788845992.887908:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.887917:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.887925:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.887970:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845992.888028:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+41:2354:x1875740720173440:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 231us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845992.888036:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00010000:00010000:2.0:1788845992.888069:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.888079:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845992.888096:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788845992.892630:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f9b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf42 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.892693:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf42 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.892734:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:2.0:1788845992.892737:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788845992.892741:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce000, rc 0) 00000100:00100000:2.0:1788845992.892879:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+41:11416:x1875740720173312:12345-192.168.206.48@tcp:101:dd.0 Request processed in 14176us (14903us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788845992.892888:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 154 00000100:00100000:1.0:1788845992.899616:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845992.899777:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720173696 00000100:00100000:3.0:1788845992.899787:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720173696 00000100:00100000:3.0:1788845992.899842:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 155 00000100:00100000:3.0:1788845992.899852:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+41:11416:x1875740720173696:12345-192.168.206.48@tcp:36:dd.0 00010000:00010000:3.0:1788845992.900519:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.900538:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845992.900550:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788845992.900605:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788845992.900630:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a69b12a0 reply state 0000000090d5e674 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845992.900639:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788845992.900750:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+44:11416:x1875740720173696:12345-192.168.206.48@tcp:36:dd.0 Request processed in 897us (1139us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788845992.900758:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 155 00000020:00080000:3.0:1788845992.900762:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788845992.906626:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.906643:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.906650:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.906656:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845992.906660:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.906668:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.906684:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:2.0:1788845992.906687:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845992.906691:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845992.906707:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773f9cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788845992.963874:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1788845992.963892:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1788845993.183599:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845993.183714:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720173824 00000100:00100000:0.0:1788845993.183723:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720173824 00000100:00100000:0.0:1788845993.183797:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 156 00000100:00100000:0.0:1788845993.183811:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c34be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+43:11430:x1875740720173824:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:0.0:1788845993.183834:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845993.183865:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f9d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf49 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.183927:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f9da lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.183950:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f9da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.183961:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f9da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.183976:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f9e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.183984:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.183990:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.184315:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f9e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.184327:0:7134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf42 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.184335:0:7134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f9e8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.184382:0:7134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf42 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.184406:0:7134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf42 expref: 44 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845993.184420:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739046016:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845993.184516:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f43c0 going to sleep for 11 seconds 00000100:00080000:3.0:1788845993.184690:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845993.186821:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739046016:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788845993.186852:0:7134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f9e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845993.187325:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845993.187812:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720174080 00000100:00100000:0.0:1788845993.187820:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720174080 00000100:00100000:0.0:1788845993.187874:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:0.0:1788845993.187882:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+45:5588:x1875740720174080:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788845993.188645:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+46:5588:x1875740720174080:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 760us (1319us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788845993.188654:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:1.0:1788845993.191956:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845993.199134:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720174208 00000100:00100000:2.0:1788845993.199149:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720174208 00010000:00010000:2.0:1788845993.199226:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf42 expref: 46 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845993.199328:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:2.0:1788845993.199339:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+46:2354:x1875740720174208:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845993.199354:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845993.199361:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf42 expref: 46 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.199374:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf42 expref: 46 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.199409:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773f9be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf42 expref: 46 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.199426:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:2.0:1788845993.199431:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f9e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.199441:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.199448:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f9e8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.199471:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845993.199547:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+45:2354:x1875740720174208:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 209us (7598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845993.199555:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 67 00010000:00010000:0.0:1788845993.199622:0:7134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199630:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845993.199669:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788845993.199673:0:7134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845993.199694:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199717:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199727:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f9da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199733:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f9da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199740:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f9da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199745:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845993.199749:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f9da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199756:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f9da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199766:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:0.0:1788845993.199769:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845993.199773:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f9da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199778:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773f9da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199788:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199794:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f9e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199805:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f9e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199816:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845993.199819:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f9e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199826:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f9e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199833:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c11677200) 00010000:00010000:0.0:1788845993.199835:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845993.199838:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f9e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199843:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773f9e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199876:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773f9d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf49 expref: 45 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199890:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f9e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf49 expref: 44 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.199896:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:0.0:1788845993.199899:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845993.199901:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce800, rc 0) 00000100:00100000:0.0:1788845993.199943:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c34be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+44:11430:x1875740720173824:12345-192.168.206.48@tcp:101:stat.0 Request processed in 16124us (16339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845993.199961:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 156 00000100:00100000:1.0:1788845993.294048:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845993.294128:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720174464 00000100:00100000:3.0:1788845993.294138:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720174464 00000100:00100000:3.0:1788845993.294218:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 157 00000100:00100000:3.0:1788845993.294228:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+44:11436:x1875740720174464:12345-192.168.206.48@tcp:36:truncate.0 00010000:00010000:3.0:1788845993.294281:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845993.294317:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce800/0x1345bc80c773f9e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf49 expref: 44 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.294333:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:3.0:1788845993.294337:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845993.294884:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f9ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.294899:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f9ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.294908:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f9ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788845993.294967:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788845993.294992:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018a69259 reply state 00000000972b5f79 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f9ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845993.295001:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788845993.295199:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+46:11436:x1875740720174464:12345-192.168.206.48@tcp:36:truncate.0 Request processed in 928us (1117us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788845993.295206:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 157 00000020:00080000:3.0:1788845993.295211:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788845993.309864:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f9ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.309881:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f9ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.309888:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f9ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.309894:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845993.309899:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f9ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.309906:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f9ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.309922:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:0.0:1788845993.309926:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845993.309945:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f9ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.309952:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773f9ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845993.484296:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845993.484487:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720174592 00000100:00100000:2.0:1788845993.484497:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720174592 00000100:00100000:2.0:1788845993.484557:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 158 00000100:00100000:2.0:1788845993.484567:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+45:11449:x1875740720174592:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:2.0:1788845993.484590:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845993.484609:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f9f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf50 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484679:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f9fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484692:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f9fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484703:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f9fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484718:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fa04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484724:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fa04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484729:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fa04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484805:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484827:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484834:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845993.484863:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788845993.484867:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845993.484885:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484908:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484924:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f9fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484939:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f9fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484945:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f9fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484950:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845993.484954:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f9fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484961:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f9fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.484981:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:2.0:1788845993.484989:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845993.484994:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f9fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.485001:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773f9fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.485015:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fa04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.485021:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fa04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.485027:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fa04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.485031:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845993.485033:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fa04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.485039:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fa04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.485047:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c04c4fc00) 00010000:00010000:2.0:1788845993.485050:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845993.485052:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fa04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.485058:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fa04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.485087:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773f9f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf50 expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.485111:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf50 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.485118:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:2.0:1788845993.485121:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845993.485123:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02825000, rc 0) 00000100:00100000:2.0:1788845993.485238:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+46:11449:x1875740720174592:12345-192.168.206.48@tcp:101:stat.0 Request processed in 672us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845993.485245:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 158 00000100:00100000:1.0:1788845993.607747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845993.607912:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720174848 00000100:00100000:3.0:1788845993.607922:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720174848 00000100:00100000:3.0:1788845993.607996:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:3.0:1788845993.608006:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+46:11460:x1875740720174848:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845993.608028:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845993.608047:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf57 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845993.608137:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788845993.608273:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa12 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf57 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.608288:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382100) 00010000:00010000:3.0:1788845993.608291:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788845993.608296:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf57 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.608309:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474c00, rc 0) 00000100:00100000:3.0:1788845993.608382:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+47:11460:x1875740720174848:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 369us (642us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788845993.608391:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:3.0:1788845993.612106:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845993.614286:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720175104 00000100:00100000:2.0:1788845993.614301:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720175104 00000100:00100000:2.0:1788845993.614412:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:2.0:1788845993.614423:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08dc3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+47:11460:x1875740720175104:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788845993.615085:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08dc3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+48:11460:x1875740720175104:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 660us (2983us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788845993.615094:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00010000:00010000:3.0:1788845993.638586:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845993.704672:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845993.704838:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720175360 00000100:00100000:1.0:1788845993.704848:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720175360 00000100:00100000:1.0:1788845993.704905:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 160 00000100:00100000:1.0:1788845993.704914:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+48:11466:x1875740720175360:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788845993.704945:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845993.704978:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fa20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf5e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845993.705074:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845993.705088:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf50 expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845993.705096:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845993.705128:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf50 expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845993.705141:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf50 expref: 49 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845993.705184:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d666680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739046144:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788845993.705279:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c0537c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788845993.712568:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d666680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739046144:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845993.712603:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845993.714208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845993.714597:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720175488 00000100:00100000:1.0:1788845993.714608:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720175488 00010000:00010000:1.0:1788845993.714646:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf50 expref: 50 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845993.714681:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:1.0:1788845993.714691:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+50:2353:x1875740720175488:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845993.714705:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845993.714712:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf50 expref: 50 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845993.714735:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf50 expref: 50 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845993.714757:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf50 expref: 50 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845993.714773:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:1.0:1788845993.714778:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845993.714787:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845993.714794:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845993.714826:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845993.714887:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+49:2353:x1875740720175488:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 197us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845993.714895:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00010000:00010000:2.0:1788845993.715211:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.715222:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845993.715248:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788845993.715409:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fa20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf5e expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.715425:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf5e expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.715432:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:2.0:1788845993.715434:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788845993.715437:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00600, rc 0) 00000100:00100000:2.0:1788845993.715843:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+49:11466:x1875740720175360:12345-192.168.206.48@tcp:101:bash.0 Request processed in 10558us (10807us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788845993.715852:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 160 00000100:00100000:2.0:1788845993.719583:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845993.719740:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720175744 00000100:00100000:3.0:1788845993.719761:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720175744 00000100:00100000:3.0:1788845993.719861:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 161 00000100:00100000:3.0:1788845993.719872:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+49:11466:x1875740720175744:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:3.0:1788845993.720113:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.720129:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.720141:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788845993.720263:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788845993.720288:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090437fa9 reply state 0000000049f303e0 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845993.720297:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788845993.720395:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+52:11466:x1875740720175744:12345-192.168.206.48@tcp:36:bash.0 Request processed in 523us (817us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788845993.720402:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 161 00000020:00080000:3.0:1788845993.720408:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788845993.727681:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.727699:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.727707:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.727712:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845993.727717:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.727724:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.727758:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:2.0:1788845993.727761:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845993.727766:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.727773:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845993.729877:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845993.729958:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720175872 00000100:00100000:0.0:1788845993.729967:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720175872 00000100:00100000:0.0:1788845993.730024:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 162 00000100:00100000:0.0:1788845993.730034:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+51:11466:x1875740720175872:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788845993.730057:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845993.730088:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fa3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf65 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.730185:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fa43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.730198:0:7134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf5e expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.730207:0:7134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fa43 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.730240:0:7134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf5e expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.730252:0:7134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf5e expref: 52 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845993.730265:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739046272:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845993.730342:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845993.736819:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845993.737238:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739046272:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788845993.737269:0:7134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fa43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845993.738263:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720176000 00000100:00100000:3.0:1788845993.738272:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720176000 00010000:00010000:3.0:1788845993.742122:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf5e expref: 53 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845993.742183:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:3.0:1788845993.742192:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+53:2354:x1875740720176000:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845993.742207:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845993.742213:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf5e expref: 53 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.742239:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf5e expref: 53 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.742260:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fa27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf5e expref: 53 pid: 5847 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.742278:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:3.0:1788845993.742283:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fa43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.742291:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fa43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.742566:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fa43 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.742602:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845993.742707:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+52:2354:x1875740720176000:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 514us (5895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845993.742715:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00010000:00010000:0.0:1788845993.742904:0:7134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fa43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.742912:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fa43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845993.742975:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788845993.742979:0:7134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845993.742998:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fa43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.743027:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fa3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf65 expref: 52 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.743043:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fa43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf65 expref: 51 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845993.743049:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:0.0:1788845993.743051:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845993.743053:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcfa00, rc 0) 00000100:00100000:0.0:1788845993.743079:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+51:11466:x1875740720175872:12345-192.168.206.48@tcp:101:bash.0 Request processed in 13048us (13210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845993.743087:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 162 00000100:00100000:1.0:1788845993.748247:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845993.748334:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720176256 00000100:00100000:0.0:1788845993.748347:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720176256 00000100:00100000:0.0:1788845993.748403:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:0.0:1788845993.748413:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+51:11466:x1875740720176256:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:0.0:1788845993.748654:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+52:11466:x1875740720176256:12345-192.168.206.48@tcp:35:bash.0 Request processed in 242us (415us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788845993.748661:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:1.0:1788845993.837934:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845993.838072:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720176512 00000100:00100000:3.0:1788845993.838082:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720176512 00000100:00100000:3.0:1788845993.838147:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 163 00000100:00100000:3.0:1788845993.838192:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+52:11476:x1875740720176512:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845993.838216:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845993.838236:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fa4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845993.838348:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788845993.838456:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fa4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf6c expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.838481:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382100) 00010000:00010000:3.0:1788845993.838484:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788845993.838489:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fa4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf6c expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.838502:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474a00, rc 0) 00000100:00100000:3.0:1788845993.838562:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+53:11476:x1875740720176512:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 374us (647us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1788845993.838569:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 163 00000100:00100000:1.0:1788845993.841560:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845993.841654:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720176640 00000100:00100000:2.0:1788845993.841663:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720176640 00000100:00100000:2.0:1788845993.841721:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 164 00000100:00100000:2.0:1788845993.841731:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+53:11476:x1875740720176640:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:2.0:1788845993.841800:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fa58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.841815:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fa58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.841827:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fa58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.841842:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.841849:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.841857:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.841966:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773fa66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.841975:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773fa66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.841982:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773fa66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845993.842017:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773fa66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842027:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fa58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842033:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fa58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842039:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fa58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842045:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845993.842049:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fa58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842056:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fa58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842066:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:2.0:1788845993.842068:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845993.842072:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fa58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842082:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fa58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842096:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842102:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842107:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842111:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845993.842114:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842119:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842126:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c04c4fc00) 00010000:00010000:2.0:1788845993.842128:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845993.842131:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842136:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842181:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773fa66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842189:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773fa66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842200:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773fa66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842205:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845993.842209:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773fa66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842215:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773fa66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842223:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:2.0:1788845993.842225:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845993.842228:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773fa66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.842234:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773fa66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845993.842312:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+53:11476:x1875740720176640:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 581us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845993.842319:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 164 00000100:00100000:2.0:1788845993.845826:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845993.845906:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720176896 00000100:00100000:0.0:1788845993.845915:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720176896 00000100:00100000:0.0:1788845993.845995:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:0.0:1788845993.846005:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+53:11476:x1875740720176896:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788845993.846261:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+54:11476:x1875740720176896:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 258us (444us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788845993.846268:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:1.0:1788845993.877989:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845993.878082:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720177152 00000100:00100000:3.0:1788845993.878091:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720177152 00000100:00100000:3.0:1788845993.878204:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 165 00000100:00100000:3.0:1788845993.878214:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+54:11479:x1875740720177152:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845993.878238:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845993.878257:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fa6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf73 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878335:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fa74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878348:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fa74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878373:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fa74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878390:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878396:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878402:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878512:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fa82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878520:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fa82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878526:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fa82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845993.878534:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788845993.878612:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fa74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878619:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fa74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878625:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fa74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878631:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845993.878640:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fa74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878647:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fa74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878658:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:3.0:1788845993.878661:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845993.878665:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fa74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878670:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fa74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878682:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878687:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878692:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878696:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845993.878698:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878703:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878708:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c31164e00) 00010000:00010000:3.0:1788845993.878710:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845993.878717:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878723:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fa7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878757:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fa6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf73 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878768:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fa82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf73 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.878775:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:3.0:1788845993.878777:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788845993.878779:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474200, rc 0) 00000100:00100000:3.0:1788845993.878838:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+56:11479:x1875740720177152:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 625us (857us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788845993.878845:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 165 00000100:00100000:1.0:1788845993.884723:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845993.884919:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720177280 00000100:00100000:2.0:1788845993.884939:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720177280 00000100:00100000:2.0:1788845993.885006:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 166 00000100:00100000:2.0:1788845993.885016:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3537f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+56:11479:x1875740720177280:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:2.0:1788845993.885079:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.885123:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.885135:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.885185:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.885193:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.885200:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.885206:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845993.885210:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.885217:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.885229:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:2.0:1788845993.885232:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845993.885236:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845993.885242:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fa90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845993.885601:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3537f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+56:11479:x1875740720177280:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 585us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845993.885615:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 166 00000100:00100000:2.0:1788845993.889634:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845993.889868:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720177408 00000100:00100000:1.0:1788845993.889878:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720177408 00000100:00100000:1.0:1788845993.889953:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1788845993.889981:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+56:2354:x1875740720177408:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845993.889995:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845993.890019:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fa82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf73 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845993.890057:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:1.0:1788845993.890067:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845993.890126:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+55:2354:x1875740720177408:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 148us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845993.890133:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1788845993.892575:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845993.893041:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720177664 00000100:00100000:0.0:1788845993.893049:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720177664 00000100:00100000:0.0:1788845993.893224:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:0.0:1788845993.893236:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+55:11479:x1875740720177664:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788845993.893604:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+56:11479:x1875740720177664:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 369us (1033us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788845993.893612:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000001:00080000:1.0:1788845993.960404:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:1.0:1788845993.960447:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788845993.960480:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a0c200ae9c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788845993.960485:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c206c7d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c200ae300 00000020:00080000:1.0:1788845993.960489:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c206c7900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c10239000 00000100:00100000:3.0:1788845993.960702:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739046400:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788845993.960768:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845993.960846:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739046400 00000100:00100000:3.0:1788845993.960854:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739046400 00000100:00100000:3.0:1788845993.960896:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788845993.960904:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739046400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788845993.960939:0:8094:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788845993.960968:0:8094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f9fa7, atime: 0x6a9f9fa8, ctime: 0x6a9f9fa7, blocks: 0xb 00010000:00010000:3.0:1788845993.960976:0:8094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa7767ed/0x1345bc80c773fa97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.961009:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1788845993.961014:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845993.961020:0:8094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7767ed/0x1345bc80c773fa97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.961053:0:8094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa7767ed/0x1345bc80c773fa97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.961064:0:8094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa7767ed/0x1345bc80c773fa97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.961073:0:8094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7767ed/0x1345bc80c773fa97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.961091:0:8094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788845993.961752:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739046400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 847us (983us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788845993.961761:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1788845993.961788:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845993.961795:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa7767ed/0x1345bc80c773fa97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.961804:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474a00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788845993.961808:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa7767ed/0x1345bc80c773fa97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.961829:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa7767ed/0x1345bc80c773fa97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.961847:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa7767ed/0x1345bc80c773fa97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.961855:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa7767ed/0x1345bc80c773fa97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845993.961873:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845993.961875:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845993.961877:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845993.961903:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1788845993.961907:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1788845993.961937:0:3307:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9a0c3eb4ce00 x1875740739046400/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788846009 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788845993.961948:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a0c3eb4ce00/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788845993.961953:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739046400:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1788845993.962363:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788845993.962622:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788845994.032579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845994.032718:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720177920 00000100:00100000:3.0:1788845994.032728:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720177920 00000100:00100000:3.0:1788845994.032794:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 167 00000100:00100000:3.0:1788845994.032805:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+16:11497:x1875740720177920:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:3.0:1788845994.032828:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845994.032847:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fa9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf7a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845994.032966:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773faa5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845994.032982:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773faa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845994.032994:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773faa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845994.033005:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788845994.033586:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fa9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf7a expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845994.033606:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773faa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf7a expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845994.033616:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:3.0:1788845994.033619:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788845994.033623:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474c00, rc 0) 00000100:00100000:3.0:1788845994.033788:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+18:11497:x1875740720177920:12345-192.168.206.48@tcp:101:cat.0 Request processed in 984us (1216us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788845994.033796:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 167 00000100:00100000:1.0:1788845994.062651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845994.062735:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720178048 00000100:00100000:0.0:1788845994.062745:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720178048 00000100:00100000:0.0:1788845994.062811:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 168 00000100:00100000:0.0:1788845994.062820:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+18:11498:x1875740720178048:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845994.062844:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845994.062863:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773fab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf81 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845994.062921:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773faba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845994.062944:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773faba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845994.062981:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773faba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845994.063013:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788845994.063016:0:7134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845994.063033:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773faba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845994.063056:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf800/0x1345bc80c773fab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf81 expref: 20 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845994.063074:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773faba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf81 expref: 19 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845994.063082:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:0.0:1788845994.063085:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845994.063089:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce600, rc 0) 00000100:00100000:0.0:1788845994.063198:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+19:11498:x1875740720178048:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 378us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845994.063205:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 168 00000100:00100000:0.0:1788845994.069130:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845994.069278:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720178432 00000100:00100000:2.0:1788845994.069287:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720178432 00000100:00100000:2.0:1788845994.069343:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:2.0:1788845994.069363:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+19:11498:x1875740720178432:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788845994.069699:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+20:11498:x1875740720178432:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 347us (588us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788845994.069706:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:1.0:1788845994.072337:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845994.072589:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720178560 00000100:00100000:2.0:1788845994.072598:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720178560 00000100:00100000:2.0:1788845994.072660:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:2.0:1788845994.072670:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c02d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+20:11498:x1875740720178560:12345-192.168.206.48@tcp:103:lfs.0 00010000:00010000:2.0:1788845994.072685:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788845994.072708:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fa43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf65 expref: 20 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845994.072730:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773faa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf7a expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845994.072743:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773f94e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf26 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845994.072753:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c11677800) 00010000:00010000:2.0:1788845994.072885:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845994.072945:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c02d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+17:11498:x1875740720178560:12345-192.168.206.48@tcp:103:lfs.0 Request processed in 275us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845994.072953:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:1.0:1788845994.075772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845994.076446:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720178688 00000100:00100000:3.0:1788845994.076455:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720178688 00000100:00100000:3.0:1788845994.076621:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 169 00000100:00100000:3.0:1788845994.076631:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+17:11498:x1875740720178688:12345-192.168.206.48@tcp:58:lfs.0 00010000:00010000:3.0:1788845994.076729:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fac1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845994.076757:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fac1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845994.076769:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fac1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788845994.077100:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788845994.077225:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+17:11498:x1875740720178688:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 595us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845994.077233:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 169 00000100:00100000:0.0:1788845994.095653:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845994.096756:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720178816 00000100:00100000:1.0:1788845994.096768:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720178816 00000100:00100000:1.0:1788845994.096838:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 170 00000100:00100000:1.0:1788845994.096849:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+17:11500:x1875740720178816:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788845994.096867:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845994.096885:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fac8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf88 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.096972:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773facf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.096987:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773facf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.096998:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773facf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097011:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fad6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097017:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097033:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097333:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fadd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097342:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fadd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097349:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fadd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845994.097383:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788845994.097387:0:7134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845994.097405:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fadd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097427:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fadd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097436:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773facf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097442:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773facf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097449:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773facf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097454:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845994.097459:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773facf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097475:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773facf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097489:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:1.0:1788845994.097492:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845994.097496:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773facf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097501:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773facf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097512:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097518:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fad6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097528:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fad6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097533:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845994.097535:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fad6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097541:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fad6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097548:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c10382200) 00010000:00010000:1.0:1788845994.097551:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845994.097553:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fad6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097559:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fad6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097590:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fac8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf88 expref: 19 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097603:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fadd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf88 expref: 18 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845994.097610:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164e00) 00010000:00010000:1.0:1788845994.097612:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845994.097614:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00600, rc 0) 00000100:00100000:1.0:1788845994.097685:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+18:11500:x1875740720178816:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 837us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845994.097700:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 170 00000100:00100000:3.0:1788845994.407857:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3ebde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739046656:0@lo:400:kworker.0 00000100:00100000:3.0:1788845994.407951:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845994.408011:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845994.408018:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3ebde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739046784:0@lo:400:kworker.0 00000100:00100000:3.0:1788845994.408041:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845994.408078:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739046656 00000100:00100000:3.0:1788845994.408085:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739046656 00000100:00100000:3.0:1788845994.408121:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739046784 00000100:00100000:3.0:1788845994.408124:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739046784 00000100:00100000:3.0:1788845994.408172:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788845994.408181:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739046656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845994.408225:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739046656:12345-0@lo:400:kworker.0 Request processed in 46us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845994.408232:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788845994.408248:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788845994.408254:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739046784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845994.408281:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739046784:12345-0@lo:400:kworker.0 Request processed in 27us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845994.408294:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1788845994.408311:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845994.408351:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3ebde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739046784:0@lo:400:kworker.0 00000100:00100000:3.0:1788845994.408363:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3ebde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739046656:0@lo:400:kworker.0 00000100:00100000:0.0:1788845994.408651:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3ebdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739046528:0@lo:400:kworker.0 00000100:00100000:0.0:1788845994.408685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845994.408717:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739047040:0@lo:400:kworker.0 00000100:00100000:0.0:1788845994.408741:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845994.408778:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845994.408785:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3ebdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739046912:0@lo:400:kworker.0 00000100:00100000:0.0:1788845994.408808:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845994.408834:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739046912 00000100:00100000:0.0:1788845994.408838:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739046912 00000100:00100000:0.0:1788845994.408875:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788845994.408886:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739046912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845994.408931:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739046912:12345-0@lo:400:kworker.0 Request processed in 39us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845994.408938:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788845994.408961:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845994.408979:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3ebdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739046912:0@lo:400:kworker.0 00000100:00100000:0.0:1788845994.408996:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739047040 00000100:00100000:0.0:1788845994.408999:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739047040 00000100:00100000:0.0:1788845994.409025:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788845994.409030:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739047040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845994.409062:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739047040:12345-0@lo:400:kworker.0 Request processed in 31us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845994.409067:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1788845994.409080:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845994.409096:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739047040:0@lo:400:kworker.0 00000100:00100000:3.0:1788845994.410729:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739046528 00000100:00100000:3.0:1788845994.410738:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739046528 00000100:00100000:3.0:1788845994.410850:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788845994.410858:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739046528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845994.410995:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739046528:12345-0@lo:400:kworker.0 Request processed in 137us (2309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845994.411002:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788845994.413903:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845994.415485:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3ebdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739046528:0@lo:400:kworker.0 00000100:00100000:1.0:1788845994.422313:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3527dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739047168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845994.422407:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845994.423921:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739047168 00000100:00100000:2.0:1788845994.423940:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739047168 00000100:00100000:2.0:1788845994.424004:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788845994.424015:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875740739047168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845994.424048:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845994.424105:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875740739047168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845994.424112:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788845994.424183:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845994.425941:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3527dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739047168:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788845994.662865:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788845994.738373:0:12506:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845994.738380:0:12506:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845994.738422:0:12506:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1788845994.738434:0:12506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788845994.908344:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845994.908415:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845994.908460:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845994.908488:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845994.908508:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845994.908556:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720179328 00000100:00100000:1.0:1788845994.908556:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720178944 00000100:00100000:3.0:1788845994.908568:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720179328 00000100:00100000:1.0:1788845994.908568:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720178944 00000100:00100000:1.0:1788845994.908624:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 286 00000100:00100000:3.0:1788845994.908626:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720179200 00000100:00100000:3.0:1788845994.908631:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720179200 00000100:00100000:1.0:1788845994.908636:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720178944:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845994.908661:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:3.0:1788845994.908670:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720179328:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845994.908709:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a77a96b-0efb-4559-b734-596c51917804+13:2352:x1875740720178944:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 74us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845994.908710:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2352:x1875740720179328:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 39us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845994.908728:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:1.0:1788845994.908730:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 286 00000100:00100000:3.0:1788845994.908748:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:3.0:1788845994.908756:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720179200:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788845994.908777:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2352:x1875740720179200:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 23us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845994.908799:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:0.0:1788845994.909284:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720179072 00000100:00100000:0.0:1788845994.909290:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720179072 00000100:00100000:0.0:1788845994.909362:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720179456 00000100:00100000:0.0:1788845994.909366:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720179456 00000100:00100000:1.0:1788845994.909410:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 130 00000100:00100000:1.0:1788845994.909419:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+18:2352:x1875740720179072:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845994.909480:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+18:2352:x1875740720179072:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 61us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845994.909488:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 130 00000100:00100000:1.0:1788845994.909504:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:1.0:1788845994.909511:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720179456:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788845994.909686:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2352:x1875740720179456:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 175us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845994.909694:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00080000:0.0:1788845994.909913:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845994.909918:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788845994.909930:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788845994.982405:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845994.982415:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845994.982470:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1788845994.982479:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788845994.982598:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3cf6a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875740739047296:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788845994.982703:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845994.985106:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3cf6a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875740739047296:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788845994.990034:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845994.990128:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720179584 00000100:00100000:1.0:1788845994.990191:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720179584 00000100:00100000:1.0:1788845994.990250:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 171 00000100:00100000:1.0:1788845994.990260:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+18:11512:x1875740720179584:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788845994.990287:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788845994.990376:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+18:11512:x1875740720179584:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 117us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845994.990387:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 171 00000100:00100000:2.0:1788845995.003253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845995.003309:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720179712 00000100:00100000:0.0:1788845995.003318:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720179712 00000100:00100000:0.0:1788845995.003389:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 172 00000100:00100000:0.0:1788845995.003399:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+18:11512:x1875740720179712:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788845995.003459:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fae4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003484:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fae4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788845995.003498:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788845995.003498:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fae4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003515:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773faeb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003533:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773faeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003540:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773faeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003561:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773faf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003569:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773faf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003577:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773faf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845995.003609:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788845995.003612:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788845995.003622:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773faf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003632:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fae4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003638:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fae4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003645:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fae4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003651:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845995.003655:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fae4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003667:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fae4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003679:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f200) 00010000:00010000:0.0:1788845995.003681:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845995.003685:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fae4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003691:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fae4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003702:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773faeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003708:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773faeb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003714:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773faeb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003719:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845995.003721:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773faeb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003727:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773faeb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003733:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9a0c11677400) 00010000:00010000:0.0:1788845995.003735:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845995.003737:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773faeb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003761:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773faeb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003774:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773faf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003780:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773faf2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003786:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773faf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003791:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845995.003794:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773faf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003800:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773faf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003806:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164e00) 00010000:00010000:0.0:1788845995.003808:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845995.003811:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773faf2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.003816:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce400/0x1345bc80c773faf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845995.003882:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+18:11512:x1875740720179712:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 484us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845995.003889:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 172 00000100:00100000:2.0:1788845995.007255:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845995.007317:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720179968 00000100:00100000:1.0:1788845995.007327:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720179968 00000100:00100000:1.0:1788845995.007385:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 173 00000100:00100000:1.0:1788845995.007395:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+18:11512:x1875740720179968:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845995.007415:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845995.007436:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773faf9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf8f expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.007534:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.007549:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.007561:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845995.007571:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788845995.007654:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.007673:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.007690:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.007696:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845995.007700:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.007706:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.007717:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164e00) 00010000:00010000:1.0:1788845995.007720:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845995.007724:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.007729:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.007951:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773faf9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf8f expref: 20 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.007963:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f200) 00010000:00010000:1.0:1788845995.007965:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788845995.007969:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773faf9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf8f expref: 20 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.007978:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00a00, rc 0) 00000100:00100000:1.0:1788845995.008046:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+19:11512:x1875740720179968:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 652us (799us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1788845995.008062:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 173 00000100:00100000:2.0:1788845995.020916:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845995.021318:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720180096 00000100:00100000:3.0:1788845995.021328:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720180096 00000100:00100000:3.0:1788845995.021382:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 174 00000100:00100000:3.0:1788845995.021392:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+19:11512:x1875740720180096:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788845995.021425:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788845995.021532:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+19:11512:x1875740720180096:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 132us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845995.021540:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 174 00000100:00100000:3.0:1788845995.024844:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845995.024913:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720180352 00000100:00100000:1.0:1788845995.024933:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720180352 00000100:00100000:1.0:1788845995.024991:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 175 00000100:00100000:1.0:1788845995.025035:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+19:11512:x1875740720180352:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845995.025055:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845995.025058:0:7134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788845995.025084:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773faba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf81 expref: 19 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.025103:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:1.0:1788845995.025109:0:7134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845995.025122:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773fb0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf96 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845995.026068:0:7134:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788845995.026490:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.026505:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.026516:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.026760:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773fb0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf96 expref: 21 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.026790:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf96 expref: 20 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.026800:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a0c10382200) 00010000:00010000:1.0:1788845995.026803:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845995.026806:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00400, rc 0) 00000100:00100000:1.0:1788845995.026985:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+20:11512:x1875740720180352:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 1953us (2149us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788845995.026994:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 175 00000100:00100000:2.0:1788845995.030564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845995.030828:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720180608 00000100:00100000:3.0:1788845995.030839:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720180608 00000100:00100000:3.0:1788845995.030903:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 176 00000100:00100000:3.0:1788845995.030915:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+20:11512:x1875740720180608:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788845995.031563:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845995.031602:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fb15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf96 expref: 20 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.031712:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a0c10382200) 00010000:00010000:3.0:1788845995.031723:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845995.031745:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.031758:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.031768:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.031795:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe24b1cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.031803:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe24b1cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.031810:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe24b1cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034290:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034306:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034315:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034322:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845995.034327:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034334:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034350:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:3.0:1788845995.034354:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845995.034359:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb23 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034366:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034392:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe24b1cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034399:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe24b1cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034405:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe24b1cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034410:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845995.034413:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe24b1cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034419:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe24b1cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034428:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe24b1cf (ffff9a0c31164b00) 00010000:00010000:3.0:1788845995.034430:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845995.034433:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe24b1cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.034439:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe24b1cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845995.034681:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+19:11512:x1875740720180608:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 3763us (4122us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788845995.034690:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 176 00000100:00100000:0.0:1788845995.038577:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845995.039988:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720180736 00000100:00100000:2.0:1788845995.040001:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720180736 00000100:00100000:2.0:1788845995.040072:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 177 00000100:00100000:2.0:1788845995.040083:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+19:11512:x1875740720180736:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845995.040103:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845995.040138:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fb31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cf9d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.040192:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fb38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.040205:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fb38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.040218:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fb38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.040308:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fb31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf9d expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.040328:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fb38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf9d expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.040336:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845995.040339:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788845995.040343:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02824c00, rc 0) 00000100:00100000:2.0:1788845995.040405:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+20:11512:x1875740720180736:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 324us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.040412:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 177 00000100:00100000:0.0:1788845995.047579:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845995.047703:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720180992 00000100:00100000:3.0:1788845995.047713:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720180992 00000100:00100000:3.0:1788845995.048754:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 178 00000100:00100000:3.0:1788845995.048794:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+20:11512:x1875740720180992:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788845995.048880:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.048896:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.048908:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788845995.049842:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788845995.049851:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327266697283ns, next at 328266695498ns, rc = 0 00000004:00010000:3.0:1788845995.049946:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdfeaf61 reply state 00000000cfcdbb7f transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845995.049956:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788845995.050059:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+22:11512:x1875740720180992:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 1280us (2494us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788845995.050067:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 178 00000100:00100000:3.0:1788845995.052996:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:0.0:1788845995.053091:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.053103:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.053111:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.053117:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845995.053122:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.053130:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.053144:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:0.0:1788845995.053147:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788845995.053185:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.053192:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fb3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845995.053494:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720181120 00000100:00100000:2.0:1788845995.053503:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720181120 00000100:00100000:2.0:1788845995.053592:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 179 00000100:00100000:2.0:1788845995.053601:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+21:11512:x1875740720181120:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845995.053632:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845995.053655:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fb46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cfa4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.053706:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fb46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfa4 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.053718:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fb46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfa4 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.053734:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845995.053736:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788845995.053739:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02825000, rc 0) 00000100:00100000:2.0:1788845995.053791:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+22:11512:x1875740720181120:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 191us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.053798:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 179 00000100:00100000:0.0:1788845995.061644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845995.061803:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720181248 00000100:00100000:3.0:1788845995.061811:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720181248 00000100:00100000:3.0:1788845995.061866:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:3.0:1788845995.061876:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+6:2354:x1875740720181248:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788845995.062982:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+7:2354:x1875740720181248:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 1102us (1340us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788845995.062993:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:0.0:1788845995.066939:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845995.067077:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720181504 00000100:00100000:2.0:1788845995.067087:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720181504 00000100:00100000:2.0:1788845995.067139:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:2.0:1788845995.067149:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+22:11512:x1875740720181504:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788845995.067407:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+23:11512:x1875740720181504:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 259us (490us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788845995.067415:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:0.0:1788845995.070017:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845995.070192:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720181760 00000100:00100000:2.0:1788845995.070202:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720181760 00000100:00100000:2.0:1788845995.070260:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 180 00000100:00100000:2.0:1788845995.070270:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+23:11512:x1875740720181760:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788845995.070409:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+23:11512:x1875740720181760:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 140us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.070431:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 180 00000100:00100000:1.0:1788845995.074040:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845995.074146:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720181888 00000100:00100000:2.0:1788845995.074218:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720181888 00000100:00100000:2.0:1788845995.074307:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 181 00000100:00100000:2.0:1788845995.074317:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+23:11512:x1875740720181888:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845995.074335:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845995.074354:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773fb4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cfab expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.074420:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.074434:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.074446:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845995.074488:0:7134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845995.074505:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.074530:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825800/0x1345bc80c773fb4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfab expref: 25 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.074548:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfab expref: 24 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.074556:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845995.074751:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788845995.074755:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030c00, rc 0) 00000100:00100000:2.0:1788845995.074810:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+24:11512:x1875740720181888:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 494us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.074817:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 181 00000100:00100000:1.0:1788845995.077337:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845995.077413:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720182016 00000100:00100000:3.0:1788845995.077433:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720182016 00000100:00100000:3.0:1788845995.077495:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:3.0:1788845995.077505:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+7:2353:x1875740720182016:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788845995.077521:0:8094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845995.077539:0:8094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007303718f/0x1345bc80c773fb5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cfb2 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788845995.077563:0:8094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9faa, blocks: 0x1 00010000:00010000:3.0:1788845995.077593:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=327s v=(0 0) 00010000:00010000:3.0:1788845995.077597:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845995.077606:0:8094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007303718f/0x1345bc80c773fb5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb2 expref: 8 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.077636:0:8094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007303718f/0x1345bc80c773fb5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb2 expref: 8 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.077648:0:8094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474000, rc 0) 00000100:00100000:3.0:1788845995.077699:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+8:2353:x1875740720182016:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 196us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845995.077706:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:0.0:1788845995.082283:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845995.082448:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720182272 00000100:00100000:2.0:1788845995.082457:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720182272 00000100:00100000:2.0:1788845995.082523:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 182 00000100:00100000:2.0:1788845995.082534:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+24:11512:x1875740720182272:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788845995.082659:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+24:11512:x1875740720182272:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 126us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.082667:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 182 00000100:00100000:1.0:1788845995.085652:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845995.085836:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720182400 00000100:00100000:0.0:1788845995.085845:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720182400 00000100:00100000:0.0:1788845995.085917:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:0.0:1788845995.085938:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:11512:x1875740720182400:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845995.085964:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845995.085982:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c773fb62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cfb9 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.086012:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007303718f/0x1345bc80c773fb5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb2 expref: 9 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.086021:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845995.086024:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845995.086029:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c773fb62 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb9 expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.086061:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007303718f/0x1345bc80c773fb5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb2 expref: 9 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.086073:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007303718f/0x1345bc80c773fb5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb2 expref: 9 pid: 8094 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845995.086086:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1875740739047424:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845995.086210:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788845995.089401:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845995.089483:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720182528 00000100:00100000:2.0:1788845995.089492:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720182528 00010000:00010000:2.0:1788845995.089533:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007303718f/0x1345bc80c773fb5b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb2 expref: 10 pid: 8094 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845995.089585:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:2.0:1788845995.089594:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+10:2353:x1875740720182528:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845995.089608:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845995.089636:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007303718f/0x1345bc80c773fb5b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb2 expref: 10 pid: 8094 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.089649:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007303718f/0x1345bc80c773fb5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb2 expref: 10 pid: 8094 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.089691:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845995.089696:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845995.089704:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c773fb62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb9 expref: 10 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.089714:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c773fb62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb9 expref: 10 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.089748:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c773fb62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb9 expref: 10 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845995.089762:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3527c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1875740739047552:192.168.206.48@tcp:105: 00000100:00100000:2.0:1788845995.089829:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074f2240 going to sleep for 11 seconds 00010000:00010000:0.0:1788845995.091118:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007303718f/0x1345bc80c773fb5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb2 expref: 10 pid: 8094 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845995.091137:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1875740739047424:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788845995.091213:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c773fb62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb9 expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.091226:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcfa00, rc 0) 00000100:00100000:0.0:1788845995.091279:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+9:11512:x1875740720182400:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 5343us (5634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845995.091287:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:2.0:1788845995.095826:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3527c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1875740739047552:192.168.206.48@tcp:105: 00010000:00010000:2.0:1788845995.095850:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845995.095906:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+8:2353:x1875740720182528:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 6312us (6512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.095917:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:1.0:1788845995.102118:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845995.102274:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720182656 00000100:00100000:0.0:1788845995.102284:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720182656 00002000:00100000:0.0:1788845995.102336:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a0c3d60e300 x1875740720182656/t0(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:346/0 lens 504/0 e 0 to 0 dl 1788846006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788845995.102346:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3d60e300 with x1875740720182656 ext(0->8) 00002000:00010000:0.0:1788845995.102351:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c3d60e300 00000100:00100000:0.0:1788845995.102373:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:0.0:1788845995.102383:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4592a189-21d8-449a-9335-07bfe0dc7877+8:2354:x1875740720182656:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788845995.102825:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4592a189-21d8-449a-9335-07bfe0dc7877+10:2354:x1875740720182656:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 Request processed in 442us (715us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788845995.102834:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00002000:00100000:0.0:1788845995.102842:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a0c3d60e300 x1875740720182656/t4294967314(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:346/0 lens 504/448 e 0 to 0 dl 1788846006 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788845995.102850:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3d60e300 with x1875740720182656 ext(0->8) 00002000:00010000:0.0:1788845995.102854:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c3d60e300 00000100:00100000:1.0:1788845995.109778:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845995.109942:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720182784 00000100:00100000:2.0:1788845995.109951:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720182784 00000100:00100000:2.0:1788845995.110009:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 183 00000100:00100000:2.0:1788845995.110019:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+24:11512:x1875740720182784:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000020:00080000:0.0:1788845995.159932:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1788845995.159977:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788845995.159997:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:0.0:1788845995.160308:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:0.0:1788845995.160332:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1788845995.160340:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:0.0:1788845995.160666:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d60c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739047680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788845995.160726:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845995.161140:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+18:11512:x1875740720182784:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 51119us (51367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845995.161179:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 183 00000100:00100000:1.0:1788845995.161430:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739047680 00000100:00100000:1.0:1788845995.161510:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739047680 00000100:00100000:1.0:1788845995.161558:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788845995.161567:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739047680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788845995.161896:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788845995.161900:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788845994 00002000:00010000:1.0:1788845995.161904:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788845995.161906:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788845994 -> 1788845994 00002000:00010000:1.0:1788845995.161908:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788845995.161981:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875740739047680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 414us (1253us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788845995.161988:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:0.0:1788845995.162114:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a0c3d60c000/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788845995.162120:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d60c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739047680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788845995.168780:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845995.169123:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720182912 00000100:00100000:1.0:1788845995.169133:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720182912 00000100:00100000:1.0:1788845995.169226:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:1.0:1788845995.169235:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4592a189-21d8-449a-9335-07bfe0dc7877+10:2353:x1875740720182912:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788845995.235028:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:3.0:1788845995.235148:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1788845995.235419:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4592a189-21d8-449a-9335-07bfe0dc7877+7:2353:x1875740720182912:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 66180us (66642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.235439:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:0.0:1788845995.239794:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845995.240310:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720183168 00000100:00100000:2.0:1788845995.240320:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720183168 00000100:00100000:2.0:1788845995.240374:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 184 00000100:00100000:2.0:1788845995.240385:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+18:11512:x1875740720183168:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788845995.240432:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845995.240469:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfab expref: 18 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.240490:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845995.240494:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845995.240522:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.240534:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.240544:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845995.240768:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002655cff3 reply state 000000003d9562ef transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845995.240777:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845995.240868:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+19:11512:x1875740720183168:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 485us (1081us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788845995.240876:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 184 00000100:00100000:1.0:1788845995.243801:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845995.244197:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720183296 00000100:00100000:0.0:1788845995.244206:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720183296 00000100:00100000:0.0:1788845995.244265:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:0.0:1788845995.244275:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2353:x1875740720183296:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788845995.244511:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788845995.244514:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788845994 -> 1788845993 00002000:00010000:0.0:1788845995.244517:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788845992 00002000:00010000:0.0:1788845995.244519:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788845994 -> 1788845993 00002000:00010000:0.0:1788845995.244521:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788845995.244575:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:2353:x1875740720183296:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 302us (782us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788845995.244583:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:3.0:1788845995.246501:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845995.246631:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720183552 00000100:00100000:0.0:1788845995.246639:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720183552 00000100:00100000:0.0:1788845995.246691:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 185 00000100:00100000:0.0:1788845995.246701:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+19:11512:x1875740720183552:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788845995.246760:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.246775:0:7134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fb38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf9d expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.246796:0:7134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.246824:0:7134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fb38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf9d expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845995.246836:0:7134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fb38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf9d expref: 19 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845995.246849:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739047808:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845995.246936:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074f2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788845995.249346:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739047808:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788845995.249377:0:7134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845995.249507:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845995.249649:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720183680 00000100:00100000:1.0:1788845995.249655:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720183680 00010000:00010000:1.0:1788845995.249685:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fb38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf9d expref: 20 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845995.249727:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:1.0:1788845995.249735:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+20:2353:x1875740720183680:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845995.249747:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845995.249752:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fb38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf9d expref: 20 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.249763:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fb38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf9d expref: 20 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.249782:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fb38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf9d expref: 20 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.249809:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:1.0:1788845995.249814:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.249822:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.249828:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.249848:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845995.249884:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+19:2353:x1875740720183680:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 149us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845995.249891:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 71 00010000:00010000:1.0:1788845995.249910:0:7134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.249916:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.249954:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.249961:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.249968:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.249973:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845995.249982:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.249990:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.249998:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:1.0:1788845995.250001:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788845995.250004:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.250009:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fb70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845995.250042:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+18:11512:x1875740720183552:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 Request processed in 3343us (3549us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788845995.250051:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 185 00000100:00100000:0.0:1788845995.252661:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845995.252809:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720183808 00000100:00100000:3.0:1788845995.252818:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720183808 00000100:00100000:3.0:1788845995.252870:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:3.0:1788845995.252879:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+8:2351:x1875740720183808:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788845995.252929:0:8094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.252949:0:8094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c773fb62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb9 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.252966:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788845995.252970:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845995.252975:0:8094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.253009:0:8094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c773fb62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb9 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.253023:0:8094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c773fb62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb9 expref: 8 pid: 6690 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845995.253036:0:8094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d67f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8094:1875740739047936:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845995.253177:0:8094:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200ae3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788845995.253373:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.253393:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.253400:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.253407:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845995.253412:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.253420:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.253435:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:2.0:1788845995.253438:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845995.253443:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.253450:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845995.256504:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845995.256608:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720183936 00000100:00100000:1.0:1788845995.256617:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720183936 00010000:00010000:1.0:1788845995.256648:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c773fb62 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb9 expref: 9 pid: 6690 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845995.256687:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:1.0:1788845995.256705:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+9:2354:x1875740720183936:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845995.256718:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845995.256736:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c773fb62 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb9 expref: 9 pid: 6690 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.256748:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c773fb62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb9 expref: 9 pid: 6690 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.256782:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788845995.256786:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788845995.256792:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.256802:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.256821:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845995.256871:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+9:2354:x1875740720183936:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 176us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845995.256877:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00010000:00010000:3.0:1788845995.260266:0:8094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c773fb62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfb9 expref: 8 pid: 6690 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845995.260311:0:8094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d67f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8094:1875740739047936:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845995.260334:0:8094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.260454:0:8094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.260530:0:8094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.260562:0:8094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.260638:0:8094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.260649:0:8094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.260657:0:8094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475800 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:2.0:1788845995.260661:0:8094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.260669:0:8094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.260688:0:8094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.260756:0:8094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dc6365a/0x1345bc80c773fb77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845995.260870:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+7:2351:x1875740720183808:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 7991us (8216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.260878:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:0.0:1788845995.263879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845995.264030:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720184192 00000100:00100000:2.0:1788845995.264040:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720184192 00000100:00100000:2.0:1788845995.264125:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 186 00000100:00100000:2.0:1788845995.264147:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+17:11512:x1875740720184192:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788845995.264342:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.264358:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.264369:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.264558:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.264568:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fb46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfa4 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.264577:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.264671:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fb46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfa4 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.264684:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fb46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfa4 expref: 18 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845995.264793:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3527c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739048064:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845995.264866:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06b98600 going to sleep for 11 seconds 00000100:00100000:1.0:1788845995.268188:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845995.268266:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720184320 00000100:00100000:3.0:1788845995.268276:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720184320 00010000:00010000:3.0:1788845995.268309:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fb46 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfa4 expref: 19 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845995.268340:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:3.0:1788845995.268349:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+19:2354:x1875740720184320:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845995.268362:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845995.268368:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fb46 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfa4 expref: 19 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.268379:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fb46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfa4 expref: 19 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.268398:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:3.0:1788845995.268402:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.268411:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.268418:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.268446:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845995.268509:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+19:2354:x1875740720184320:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 161us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845995.268517:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 73 00010000:00010000:2.0:1788845995.269882:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fb46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfa4 expref: 18 pid: 5845 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845995.269931:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3527c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739048064:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845995.270016:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.270026:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.270033:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788845995.270540:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788845995.270777:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788845995.270827:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788845995.270910:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3527c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1875740739048192:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788845995.271091:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845995.271290:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c2209f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845995.271362:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739048192 00000100:00100000:1.0:1788845995.271369:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739048192 00000100:00100000:1.0:1788845995.271416:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845995.271426:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875740739048192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788845995.271500:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875740739048192:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845995.271507:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788845995.271676:0:5847:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788845995.271683:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a0c3d60c000, transno 4294967315 00000100:00100000:3.0:1788845995.272063:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3527c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1875740739048192:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788845995.272491:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788845995.272550:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d67f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1875740739048320:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788845995.272606:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845995.272631:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200ae900 going to sleep for 11 seconds 00000100:00100000:2.0:1788845995.272810:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739048320 00000100:00100000:2.0:1788845995.272815:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739048320 00000100:00100000:2.0:1788845995.272843:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788845995.272849:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875740739048320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788845995.273007:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1875740739048320:12345-0@lo:1000:mdt00_002.0 Request processed in 157us (400us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788845995.273014:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788845995.273192:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d67f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1875740739048320:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788845995.273219:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273228:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273235:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273241:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845995.273246:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273254:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273278:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a0c04c4fb00) 00010000:00010000:3.0:1788845995.273281:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845995.273285:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273291:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb85 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273318:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fac1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273325:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fac1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273331:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fac1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273336:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845995.273339:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fac1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273345:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fac1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273352:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164e00) 00010000:00010000:3.0:1788845995.273354:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845995.273357:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fac1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273362:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fac1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273392:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273404:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fadd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf88 expref: 21 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273413:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273436:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fadd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf88 expref: 21 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.273449:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fadd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf88 expref: 21 pid: 7134 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845995.273470:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d67e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739048448:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788845995.273526:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200ae900 going to sleep for 11 seconds 00000100:00100000:1.0:1788845995.277035:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845995.277478:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720184448 00000100:00100000:2.0:1788845995.277487:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720184448 00010000:00010000:2.0:1788845995.277526:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fadd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf88 expref: 22 pid: 7134 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845995.277591:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:2.0:1788845995.277600:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+22:2353:x1875740720184448:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845995.277614:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845995.277621:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fadd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf88 expref: 22 pid: 7134 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.277634:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fadd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf88 expref: 22 pid: 7134 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.277655:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164e00) 00010000:00010000:2.0:1788845995.277660:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.277668:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.277675:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845995.277705:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845995.277748:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+22:2353:x1875740720184448:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 150us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.277756:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 74 00010000:00010000:3.0:1788845995.278990:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fadd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cf88 expref: 21 pid: 7134 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845995.279009:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d67e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739048448:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845995.279028:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279333:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279342:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279371:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279377:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279383:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279388:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845995.279392:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279399:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279412:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164e00) 00010000:00010000:1.0:1788845995.279415:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845995.279419:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279425:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fb8c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279435:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279440:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279445:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279455:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845995.279458:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279475:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279484:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164e00) 00010000:00010000:1.0:1788845995.279486:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788845995.279489:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.279494:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fb7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845995.279897:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+20:11512:x1875740720184192:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 15749us (16024us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788845995.279906:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 186 00000020:00080000:1.0:1788845995.279911:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788845995.282091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845995.282182:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720184704 00000100:00100000:3.0:1788845995.282190:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720184704 00000100:00100000:3.0:1788845995.282237:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:3.0:1788845995.282247:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08dc2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+20:11512:x1875740720184704:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788845995.282953:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788845995.283042:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788845995.283081:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.283096:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.283107:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.283127:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb93 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.283134:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb93 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.283141:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845995.283405:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788845995.283496:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08dc2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+22:11512:x1875740720184704:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 1248us (1411us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788845995.283504:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000020:00080000:3.0:1788845995.283508:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1788845995.285408:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788845995.285415:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788845995.286308:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788845995.286318:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788845995.286537:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845995.286546:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.286556:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788845995.286561:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.286570:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.286654:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a0c31164f00) 00010000:00010000:1.0:1788845995.286657:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788845995.286662:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb93 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.286668:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fb93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845995.286686:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845995.286688:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845995.286690:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845995.687986:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788845996.519565:0:12559:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788845996.519573:0:12559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788845996.519630:0:12559:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788845996.519636:0:12559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788845996.690261:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845996.690396:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720184960 00000100:00100000:2.0:1788845996.690407:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720184960 00000100:00100000:2.0:1788845996.690464:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 187 00000100:00100000:2.0:1788845996.690475:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+22:11529:x1875740720184960:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845996.690495:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845996.690513:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cfc0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.690597:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773fba1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.690612:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773fba1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.690626:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773fba1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845996.690636:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788845996.690751:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fb9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfc0 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.690767:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773fba1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfc0 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.690775:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:2.0:1788845996.690778:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788845996.690782:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030e00, rc 0) 00000100:00100000:2.0:1788845996.690842:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+24:11529:x1875740720184960:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 368us (591us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788845996.690863:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 187 00000100:00100000:0.0:1788845996.695891:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845996.698082:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720185088 00000100:00100000:3.0:1788845996.698097:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720185088 00000100:00100000:3.0:1788845996.698186:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 188 00000100:00100000:3.0:1788845996.698198:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+24:11529:x1875740720185088:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:3.0:1788845996.698280:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fbaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698296:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fbaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698307:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fbaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698322:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fbb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698329:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fbb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698337:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fbb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698549:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fbbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698559:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fbbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698567:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fbbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845996.698604:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fbbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698616:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fbaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698631:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fbaf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698638:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fbaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698644:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845996.698648:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fbaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698656:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fbaf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698669:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:3.0:1788845996.698673:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845996.698678:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fbaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698684:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fbaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698697:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fbb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698703:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fbb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698709:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fbb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698714:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845996.698722:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fbb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698728:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fbb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698737:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c31164800) 00010000:00010000:3.0:1788845996.698739:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845996.698742:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fbb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698748:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fbb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698761:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fbbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698767:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fbbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698773:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fbbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698777:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845996.698780:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fbbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698786:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fbbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698793:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c31164600) 00010000:00010000:3.0:1788845996.698795:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845996.698803:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fbbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.698809:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fbbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845996.698893:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+24:11529:x1875740720185088:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 696us (3010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845996.698900:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 188 00010000:00010000:0.0:1788845996.710346:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845996.754842:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845996.754928:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720185344 00000100:00100000:2.0:1788845996.754939:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720185344 00000100:00100000:2.0:1788845996.754997:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 189 00000100:00100000:2.0:1788845996.755007:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+24:11532:x1875740720185344:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845996.755027:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845996.755047:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fbc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cfc7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.755114:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fbcb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.755129:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fbcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.755138:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fbcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.755712:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fbd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.755723:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.755732:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756085:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fbd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756106:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756113:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845996.756123:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788845996.756616:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fbcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756627:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fbcb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756635:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fbcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756641:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845996.756646:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fbcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756654:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fbcb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756667:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:2.0:1788845996.756669:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845996.756674:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fbcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756680:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fbcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756692:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756705:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fbd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756711:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756716:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845996.756719:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756725:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fbd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756734:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c04c4fc00) 00010000:00010000:2.0:1788845996.756736:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845996.756738:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fbd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756743:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fbd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756790:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fbc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfc7 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756804:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fbd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfc7 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.756888:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4f400) 00010000:00010000:2.0:1788845996.756892:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845996.756901:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02824c00, rc 0) 00000100:00100000:2.0:1788845996.757042:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+26:11532:x1875740720185344:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 2034us (2207us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788845996.757051:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 189 00000100:00100000:0.0:1788845996.761928:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845996.762015:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720185472 00000100:00100000:1.0:1788845996.762025:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720185472 00000100:00100000:1.0:1788845996.762085:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 190 00000100:00100000:1.0:1788845996.762097:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+26:11532:x1875740720185472:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:1.0:1788845996.762192:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fbe7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.762209:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.762220:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.762244:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.762267:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fbe7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.762274:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fbe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.762279:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845996.762293:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fbe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.762301:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fbe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.762313:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4f400) 00010000:00010000:1.0:1788845996.762316:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788845996.762320:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fbe7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.762326:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fbe7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845996.762395:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+26:11532:x1875740720185472:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 300us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845996.762403:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 190 00000100:00100000:0.0:1788845996.773693:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845996.774846:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720185728 00000100:00100000:1.0:1788845996.774858:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720185728 00000100:00100000:1.0:1788845996.774938:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:1.0:1788845996.774950:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+26:11532:x1875740720185728:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1788845996.775212:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+27:11532:x1875740720185728:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 262us (1527us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788845996.775232:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:0.0:1788845996.809247:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845996.810275:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720185984 00000100:00100000:1.0:1788845996.810286:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720185984 00000100:00100000:1.0:1788845996.810348:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 191 00000100:00100000:1.0:1788845996.810358:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+27:11059:x1875740720185984:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788845996.810381:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845996.810400:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fbee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cfce expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.810568:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.810637:0:7134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fbd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfc7 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.810648:0:7134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.810680:0:7134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fbd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfc7 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.810692:0:7134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fbd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfc7 expref: 28 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845996.810705:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d60c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739048576:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788845996.810920:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1167b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845996.815506:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845996.816202:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d60c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739048576:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788845996.816239:0:7134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845996.816780:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720186112 00000100:00100000:3.0:1788845996.816788:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720186112 00010000:00010000:3.0:1788845996.817098:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fbd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfc7 expref: 29 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845996.817145:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:3.0:1788845996.817184:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+29:2353:x1875740720186112:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845996.817199:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845996.817204:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fbd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfc7 expref: 29 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.817216:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fbd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfc7 expref: 29 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.817236:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fbd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfc7 expref: 29 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.817251:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4f400) 00010000:00010000:3.0:1788845996.817256:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.817280:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.817287:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.817318:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845996.817435:0:7134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.817442:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845996.817468:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788845996.817624:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fbee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfce expref: 30 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.817640:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfce expref: 29 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.817647:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4f400) 00010000:00010000:1.0:1788845996.817650:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788845996.817652:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01400, rc 0) 00000100:00100000:3.0:1788845996.817696:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+29:2353:x1875740720186112:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 541us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845996.817704:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:1.0:1788845996.817903:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+28:11059:x1875740720185984:12345-192.168.206.48@tcp:101:bash.0 Request processed in 7546us (8664us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788845996.817919:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 191 00000100:00100000:0.0:1788845996.821741:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845996.821838:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720186368 00000100:00100000:1.0:1788845996.821849:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720186368 00000100:00100000:1.0:1788845996.821908:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 192 00000100:00100000:1.0:1788845996.821931:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+28:11059:x1875740720186368:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:1.0:1788845996.822224:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773fc03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.822258:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773fc03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.822269:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773fc03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788845996.822323:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788845996.822350:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc2ad94c reply state 00000000a1c3b991 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773fc03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845996.822358:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788845996.822405:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788845996.823605:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+32:11059:x1875740720186368:12345-192.168.206.48@tcp:36:bash.0 Request processed in 1671us (1867us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788845996.823615:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 192 00000020:00080000:1.0:1788845996.823620:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788845996.826246:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:0.0:1788845996.826727:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773fc03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845996.826741:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773fc03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845996.826748:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773fc03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845996.826768:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845996.826773:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773fc03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845996.826780:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773fc03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845996.826796:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4f400) 00010000:00010000:0.0:1788845996.826799:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845996.826804:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773fc03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845996.826820:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00a00/0x1345bc80c773fc03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845996.826893:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720186496 00000100:00100000:3.0:1788845996.826901:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720186496 00000100:00100000:3.0:1788845996.826967:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 193 00000100:00100000:3.0:1788845996.826977:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+31:11059:x1875740720186496:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1788845996.827000:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845996.827018:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fc0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cfd5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.827067:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fc0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfd5 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.827079:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fc0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfd5 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.827095:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4f400) 00010000:00010000:3.0:1788845996.827097:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788845996.827100:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474c00, rc 0) 00000100:00100000:3.0:1788845996.827181:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+32:11059:x1875740720186496:12345-192.168.206.48@tcp:101:bash.0 Request processed in 204us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845996.827187:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 193 00000100:00100000:1.0:1788845996.830879:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845996.831086:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720186624 00000100:00100000:2.0:1788845996.831095:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720186624 00000100:00100000:2.0:1788845996.831192:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:2.0:1788845996.831203:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4592a189-21d8-449a-9335-07bfe0dc7877+7:11059:x1875740720186624:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788845996.831220:0:11681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845996.831240:0:11681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbe57a67/0x1345bc80c773fc11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cfdc expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845996.831265:0:11681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f9fa9, atime: 0x6a9f9fa8, ctime: 0x6a9f9fa9, blocks: 0xb 00010000:00010000:2.0:1788845996.831286:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1788845996.831291:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845996.831299:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbe57a67/0x1345bc80c773fc11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfdc expref: 8 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.831316:0:11681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fbe57a67/0x1345bc80c773fc11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfdc expref: 8 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.831328:0:11681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02825800, rc 0) 00000100:00100000:2.0:1788845996.831376:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4592a189-21d8-449a-9335-07bfe0dc7877+8:11059:x1875740720186624:12345-192.168.206.48@tcp:101:bash.0 Request processed in 175us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845996.831382:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00080000:0.0:1788845996.831983:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845996.833977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845996.834245:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720186752 00000100:00100000:3.0:1788845996.834256:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720186752 00002000:00010000:3.0:1788845996.834296:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788845996.834301:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c348d8000 with x1875740720186752 ext(0->18446744073709551615) 00002000:00010000:3.0:1788845996.834312:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c348d8000. 00000100:00100000:3.0:1788845996.834344:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:3.0:1788845996.834355:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4592a189-21d8-449a-9335-07bfe0dc7877+8:2354:x1875740720186752:12345-192.168.206.48@tcp:10:bash.0 00002000:00010000:3.0:1788845996.834621:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788845996.834624:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788845993 -> 1788845996 00002000:00010000:3.0:1788845996.834627:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788845992 -> 1788845992 00002000:00010000:3.0:1788845996.834629:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788845993 -> 1788845996 00002000:00010000:3.0:1788845996.834632:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788845996.835268:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4592a189-21d8-449a-9335-07bfe0dc7877+9:2354:x1875740720186752:12345-192.168.206.48@tcp:10:bash.0 Request processed in 912us (1295us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788845996.835278:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00002000:00010000:3.0:1788845996.835281:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788845996.835284:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c348d8000 with x1875740720186752 ext(0->18446744073709551615) 00002000:00010000:3.0:1788845996.835290:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c348d8000. 00000100:00100000:3.0:1788845996.913026:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845996.913127:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720186880 00000100:00100000:1.0:1788845996.913137:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720186880 00000100:00100000:1.0:1788845996.913233:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 194 00000100:00100000:1.0:1788845996.913248:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+32:11546:x1875740720186880:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:1.0:1788845996.913316:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913332:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913343:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913370:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fc1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913377:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fc1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913383:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fc1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913606:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913615:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913623:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845996.913658:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913669:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913676:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913697:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913703:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845996.913707:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913721:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913734:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:1.0:1788845996.913737:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845996.913742:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913747:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913759:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fc1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913765:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fc1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913771:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fc1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913775:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845996.913778:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fc1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913783:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fc1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913790:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c10382400) 00010000:00010000:1.0:1788845996.913792:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845996.913795:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fc1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913812:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fc1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913827:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913833:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913838:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913842:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845996.913845:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913851:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913858:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4f400) 00010000:00010000:1.0:1788845996.913860:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845996.913862:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.913867:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845996.913939:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+32:11546:x1875740720186880:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 695us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845996.913947:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 194 00000100:00100000:1.0:1788845996.952845:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845996.952940:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720187136 00000100:00100000:3.0:1788845996.952950:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720187136 00000100:00100000:3.0:1788845996.953001:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 195 00000100:00100000:3.0:1788845996.953010:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+32:11549:x1875740720187136:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845996.953042:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845996.953062:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fc2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cfe3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953127:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fc34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953140:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fc34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953205:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fc34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953229:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fc3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953237:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fc3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953244:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fc3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953475:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fc42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953484:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fc42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953492:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fc42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845996.953501:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788845996.953593:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fc34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953601:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fc34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953607:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fc34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953613:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845996.953617:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fc34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953625:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fc34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953636:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:3.0:1788845996.953639:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845996.953643:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fc34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953649:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fc34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953661:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fc3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953666:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fc3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953672:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fc3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953860:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845996.953872:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fc3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953880:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fc3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953888:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c31164600) 00010000:00010000:3.0:1788845996.953891:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845996.953895:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fc3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.953901:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fc3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845996.954020:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474a00/0x1345bc80c773fc2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfe3 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845996.954036:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fc42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfe3 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845996.954043:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4f400) 00010000:00010000:0.0:1788845996.954046:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788845996.954048:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474000, rc 0) 00000100:00100000:0.0:1788845996.954112:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+34:11549:x1875740720187136:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1102us (1274us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788845996.954120:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 195 00000100:00100000:3.0:1788845996.958313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845996.958383:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720187264 00000100:00100000:1.0:1788845996.958393:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720187264 00000100:00100000:1.0:1788845996.958449:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 196 00000100:00100000:1.0:1788845996.958459:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+34:11549:x1875740720187264:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:1.0:1788845996.958520:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.958536:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfce expref: 34 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.958544:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.958586:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfce expref: 34 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845996.958599:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfce expref: 34 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845996.958611:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d60df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739048704:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788845996.958702:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1167b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788845996.965284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845996.966728:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720187520 00000100:00100000:0.0:1788845996.966741:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720187520 00000100:00100000:0.0:1788845996.966798:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:0.0:1788845996.966806:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+35:5588:x1875740720187520:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788845996.967331:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d60df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875740739048704:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788845996.967355:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845996.967388:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+36:5588:x1875740720187520:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 581us (2109us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788845996.967396:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:0.0:1788845996.969411:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845996.969484:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720187648 00000100:00100000:2.0:1788845996.969494:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720187648 00010000:00010000:2.0:1788845996.969540:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfce expref: 36 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845996.969586:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:2.0:1788845996.969596:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c02d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+36:2353:x1875740720187648:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845996.969628:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845996.969636:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfce expref: 36 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.969650:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfce expref: 36 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.969673:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fbf5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfce expref: 36 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.969690:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4f400) 00010000:00010000:2.0:1788845996.969695:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.969703:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.969710:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845996.969744:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845996.969798:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c02d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+35:2353:x1875740720187648:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 202us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845996.969813:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 76 00010000:00010000:3.0:1788845996.970663:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.970675:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.970704:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.970711:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.970717:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.970723:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788845996.970735:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.970742:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.970754:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4f400) 00010000:00010000:3.0:1788845996.970757:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788845996.970761:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845996.970767:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845996.970815:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+34:11549:x1875740720187264:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 12357us (12509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845996.970823:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 196 00000100:00100000:1.0:1788845996.973602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845996.973735:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720187904 00000100:00100000:0.0:1788845996.973744:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720187904 00000100:00100000:0.0:1788845996.973791:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:0.0:1788845996.973799:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+34:11549:x1875740720187904:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788845996.974258:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+35:11549:x1875740720187904:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 458us (668us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788845996.974266:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:0.0:1788845997.068562:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.068648:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720188160 00000100:00100000:1.0:1788845997.068668:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720188160 00000100:00100000:1.0:1788845997.068735:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 197 00000100:00100000:1.0:1788845997.068744:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+35:11561:x1875740720188160:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:1.0:1788845997.068766:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845997.068783:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fc57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cfea expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.068857:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.068871:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.068881:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.068893:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.068899:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.068905:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069138:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fc6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069147:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fc6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069189:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fc6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845997.069205:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788845997.069280:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069286:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069292:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069297:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845997.069301:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069307:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069317:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:1.0:1788845997.069320:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845997.069324:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069329:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fc5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069340:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069345:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069359:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069363:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845997.069366:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069371:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069377:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c10382400) 00010000:00010000:1.0:1788845997.069380:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845997.069382:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069388:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069424:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fc57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfea expref: 38 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069437:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fc6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfea expref: 37 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.069443:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4f400) 00010000:00010000:1.0:1788845997.069445:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845997.069447:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01400, rc 0) 00000100:00100000:1.0:1788845997.069499:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+37:11561:x1875740720188160:12345-192.168.206.48@tcp:101:cat.0 Request processed in 755us (953us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788845997.069514:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 197 00000100:00080000:0.0:1788845997.069967:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845997.075381:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845997.075504:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720188416 00000100:00100000:0.0:1788845997.075513:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720188416 00000100:00100000:0.0:1788845997.075575:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:0.0:1788845997.075584:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+37:11561:x1875740720188416:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:0.0:1788845997.075812:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+38:11561:x1875740720188416:12345-192.168.206.48@tcp:35:cat.0 Request processed in 227us (438us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788845997.075819:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:3.0:1788845997.099299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845997.099471:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720188672 00000100:00100000:2.0:1788845997.099480:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720188672 00000100:00100000:2.0:1788845997.099538:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 198 00000100:00100000:2.0:1788845997.099557:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+38:11562:x1875740720188672:12345-192.168.206.48@tcp:36:rm.0 00010000:00010000:2.0:1788845997.099607:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788845997.099632:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fc6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfea expref: 38 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.099656:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474000/0x1345bc80c773fc42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfe3 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.099670:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474c00/0x1345bc80c773fc0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfd5 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.099679:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4f400) 00010000:00010000:2.0:1788845997.099688:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845997.099709:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fc7a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.099722:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fc7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.099732:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fc7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.099746:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fc81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.099771:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fc81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.099778:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fc81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100019:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fc88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100028:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fc88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100035:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fc88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788845997.100632:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788845997.100643:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329317488580ns, next at 330317486252ns, rc = 0 00010000:00010000:2.0:1788845997.100701:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fc8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100710:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fc8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100718:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fc8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100724:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fc8f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100730:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fc8f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100745:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fc8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100769:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788845997.100788:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fc88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100795:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fc88 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100801:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fc88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100806:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845997.100810:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fc88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100817:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fc88 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100826:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4ff00) 00010000:00010000:2.0:1788845997.100828:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788845997.100832:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fc88 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100838:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030c00/0x1345bc80c773fc88 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100855:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fc7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100860:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fc7a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100871:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fc7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100877:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845997.100880:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fc7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100886:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fc7a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100894:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:2.0:1788845997.100896:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845997.100899:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fc7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.100905:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fc7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845997.100924:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad92b70e reply state 0000000021ef525a transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fc81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845997.100932:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845997.101003:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+37:11562:x1875740720188672:12345-192.168.206.48@tcp:36:rm.0 Request processed in 1455us (1711us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788845997.101010:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 198 00010000:00010000:1.0:1788845997.101201:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845997.101208:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fc8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.101214:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788845997.101218:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fc8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.101225:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fc8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.101233:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a0c04c4ff00) 00010000:00010000:1.0:1788845997.101235:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788845997.101239:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fc8f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.101244:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030000/0x1345bc80c773fc8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.101256:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845997.101257:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845997.101259:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845997.104744:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fc81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.104760:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fc81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.104783:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fc81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.104789:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845997.104793:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fc81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.104800:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fc81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.104814:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c04c4fe00) 00010000:00010000:2.0:1788845997.104817:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845997.104820:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fc81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.104825:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fc81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845997.145637:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.145743:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720188928 00000100:00100000:1.0:1788845997.145753:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720188928 00000100:00100000:1.0:1788845997.145814:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 199 00000100:00100000:1.0:1788845997.145824:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+36:11568:x1875740720188928:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788845997.145847:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845997.145875:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fc96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cff1 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146007:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146021:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146033:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146047:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fca4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146055:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fca4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146062:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fca4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845997.146560:0:7134:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788845997.146693:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fcab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146702:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fcab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146709:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fcab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146737:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146751:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc9d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146757:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146763:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845997.146767:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146773:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146783:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:1.0:1788845997.146785:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845997.146789:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146794:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fc9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845997.146806:0:7134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0e91443 reply state 00000000ed6357e5 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fca4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845997.146814:0:7134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788845997.146837:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fc96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff1 expref: 39 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146851:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fcab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff1 expref: 38 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.146868:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382800) 00010000:00010000:1.0:1788845997.146871:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845997.146874:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01c00, rc 0) 00000100:00100000:1.0:1788845997.146937:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+39:11568:x1875740720188928:12345-192.168.206.48@tcp:101:bash.0 Request processed in 1114us (1308us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788845997.146944:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 199 00010000:00010000:0.0:1788845997.149951:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fca4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.149984:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fca4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.149992:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fca4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.149997:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845997.150002:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fca4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.150010:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fca4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.150026:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c10382400) 00010000:00010000:0.0:1788845997.150029:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845997.150033:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fca4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.150039:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01a00/0x1345bc80c773fca4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845997.152906:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.153361:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720189056 00000100:00100000:1.0:1788845997.153371:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720189056 00000100:00100000:1.0:1788845997.153481:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:1.0:1788845997.153492:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2353:x1875740720189056:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788845997.153509:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845997.153529:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf97209c/0x1345bc80c773fcb9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cff8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788845997.153563:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788845997.153581:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1788845997.153586:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845997.153596:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf97209c/0x1345bc80c773fcb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff8 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.153613:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf97209c/0x1345bc80c773fcb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff8 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.153627:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00a00, rc 0) 00000100:00100000:1.0:1788845997.153689:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2353:x1875740720189056:12345-192.168.206.48@tcp:101:bash.0 Request processed in 198us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845997.153708:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:1.0:1788845997.156316:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845997.156413:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720189184 00000100:00100000:2.0:1788845997.156422:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720189184 00000100:00100000:2.0:1788845997.156481:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:2.0:1788845997.156491:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+6:11568:x1875740720189184:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788845997.156507:0:8094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845997.156524:0:8094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305cfff expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.156757:0:8094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf97209c/0x1345bc80c773fcb9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff8 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.156783:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845997.156787:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845997.156792:0:8094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 7 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.156825:0:8094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf97209c/0x1345bc80c773fcb9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff8 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.156838:0:8094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf97209c/0x1345bc80c773fcb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff8 expref: 7 pid: 6689 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845997.156852:0:8094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3527ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8094:1875740739048832:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845997.156990:0:8094:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b0421d540 going to sleep for 11 seconds 00000100:00080000:0.0:1788845997.157021:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845997.159762:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.160094:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720189312 00000100:00100000:1.0:1788845997.160103:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720189312 00010000:00010000:1.0:1788845997.160180:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf97209c/0x1345bc80c773fcb9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff8 expref: 8 pid: 6689 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845997.160224:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:1.0:1788845997.160234:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+8:2354:x1875740720189312:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845997.160247:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845997.160268:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf97209c/0x1345bc80c773fcb9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff8 expref: 8 pid: 6689 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.160280:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf97209c/0x1345bc80c773fcb9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff8 expref: 8 pid: 6689 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.160303:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845997.160307:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845997.160314:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 8 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.160324:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 8 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.160362:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 8 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845997.160391:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d60f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5831:1875740739048960:192.168.206.48@tcp:105: 00000100:00100000:1.0:1788845997.160473:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1167b180 going to sleep for 11 seconds 00010000:00010000:3.0:1788845997.162409:0:8094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf97209c/0x1345bc80c773fcb9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff8 expref: 8 pid: 6689 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845997.162431:0:8094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3527ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8094:1875740739048832:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788845997.162470:0:8094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 7 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.162484:0:8094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c00030c00, rc 0) 00000100:00100000:3.0:1788845997.162538:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+7:11568:x1875740720189184:12345-192.168.206.48@tcp:101:bash.0 Request processed in 6048us (6229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845997.162566:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:3.0:1788845997.162857:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d60f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5831:1875740739048960:192.168.206.48@tcp:105: 00010000:00010000:3.0:1788845997.162869:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845997.162903:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+6:2354:x1875740720189312:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 2671us (3148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845997.162921:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:0.0:1788845997.164854:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845997.164890:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720189568 00000100:00100000:2.0:1788845997.164899:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720189568 00000100:00100000:2.0:1788845997.164971:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:2.0:1788845997.164981:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+38:11568:x1875740720189568:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:2.0:1788845997.165425:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+39:11568:x1875740720189568:12345-192.168.206.48@tcp:35:bash.0 Request processed in 443us (576us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788845997.165434:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:2.0:1788845997.332241:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845997.332355:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720189696 00000100:00100000:0.0:1788845997.332364:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720189696 00000100:00100000:3.0:1788845997.332491:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 200 00000100:00100000:3.0:1788845997.332643:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+39:11584:x1875740720189696:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845997.332669:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845997.332786:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fcc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d006 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.332854:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fcce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.332869:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fcce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.332880:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fcce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845997.332923:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788845997.332926:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788845997.332943:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fcce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.332968:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fcc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d006 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.333005:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fcce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d006 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.333013:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:3.0:1788845997.333017:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788845997.333020:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475a00, rc 0) 00000100:00100000:3.0:1788845997.333125:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+40:11584:x1875740720189696:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 485us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845997.338824:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 200 00000100:00100000:0.0:1788845997.340441:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.340577:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720189952 00000100:00100000:1.0:1788845997.340586:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720189952 00000100:00100000:1.0:1788845997.340640:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 201 00000100:00100000:1.0:1788845997.340649:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+40:11584:x1875740720189952:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788845997.340670:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845997.340689:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fcd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d00d expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.340785:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fcdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.340799:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fcdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.340811:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fcdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845997.340823:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788845997.340960:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fcd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d00d expref: 43 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.340984:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fcdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d00d expref: 42 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.340993:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382800) 00010000:00010000:1.0:1788845997.341010:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845997.341014:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01200, rc 0) 00000100:00100000:1.0:1788845997.341091:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+42:11584:x1875740720189952:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 442us (657us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788845997.341100:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 201 00000100:00100000:2.0:1788845997.345930:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845997.346016:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.346669:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720190336 00000100:00100000:1.0:1788845997.346680:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720190336 00000100:00100000:1.0:1788845997.346751:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:1.0:1788845997.346762:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+42:2353:x1875740720190336:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845997.346778:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845997.346803:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fcdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d00d expref: 42 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.346821:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382800) 00010000:00010000:1.0:1788845997.346825:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845997.347238:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720190208 00000100:00100000:3.0:1788845997.347244:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720190208 00000100:00100000:3.0:1788845997.347288:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 202 00000100:00100000:3.0:1788845997.347296:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+42:11584:x1875740720190208:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1788845997.347317:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845997.347331:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fcea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d014 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.347423:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fcf1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.347437:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fcf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.347448:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fcf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845997.347460:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:1.0:1788845997.347710:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+43:2353:x1875740720190336:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 949us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845997.347718:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00010000:00010000:3.0:1788845997.349396:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fcea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d014 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.349421:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fcf1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d014 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.349431:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382800) 00010000:00010000:3.0:1788845997.349434:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788845997.349437:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475800, rc 0) 00000100:00100000:3.0:1788845997.349559:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+43:11584:x1875740720190208:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 2263us (3637us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788845997.349569:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 202 00000040:00080000:0.0:1788845997.350795:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845997.350803:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845997.351010:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788845997.351016:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788845997.360376:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.360683:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720190464 00000100:00100000:1.0:1788845997.360693:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720190464 00000100:00100000:1.0:1788845997.360785:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:1.0:1788845997.360794:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+6:2351:x1875740720190464:12345-192.168.206.48@tcp:1:lfs.0 00010000:00010000:1.0:1788845997.360831:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.360862:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 6 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.360888:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845997.360892:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788845997.360897:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.360945:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 6 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.360961:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 6 pid: 8094 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845997.360976:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d60e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875740739049088:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788845997.361065:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1167b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788845997.363258:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d60e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875740739049088:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788845997.363283:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845997.363778:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.363850:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720190592 00000100:00100000:1.0:1788845997.363857:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720190592 00002000:00100000:1.0:1788845997.363899:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a0c3527c380 x1875740720190592/t0(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:348/0 lens 504/0 e 0 to 0 dl 1788846008 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788845997.363919:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3527c380 with x1875740720190592 ext(0->8) 00010000:00010000:1.0:1788845997.363927:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 7 pid: 8094 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.363962:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 7 pid: 8094 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788845997.363969:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a0c3527c380 00000100:00100000:1.0:1788845997.364006:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1788845997.364017:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2354:x1875740720190592:12345-192.168.206.48@tcp:4:lfs.0 00000100:00100000:1.0:1788845997.364483:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4592a189-21d8-449a-9335-07bfe0dc7877+9:2354:x1875740720190592:12345-192.168.206.48@tcp:4:lfs.0 Request processed in 467us (705us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788845997.364491:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00002000:00100000:1.0:1788845997.364499:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a0c3527c380 x1875740720190592/t4294967308(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:348/0 lens 504/448 e 0 to 0 dl 1788846008 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788845997.364508:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3527c380 with x1875740720190592 ext(0->8) 00010000:00010000:1.0:1788845997.364515:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 9 pid: 8094 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.364528:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 9 pid: 8094 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788845997.364535:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a0c3527c380 00000100:00100000:2.0:1788845997.369094:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845997.369207:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720190720 00000100:00100000:0.0:1788845997.369215:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720190720 00010000:00010000:0.0:1788845997.369260:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 9 pid: 8094 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845997.369308:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:0.0:1788845997.369318:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+9:2353:x1875740720190720:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845997.369334:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788845997.369353:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788845997.369356:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788845997 00002000:00010000:0.0:1788845997.369358:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788845997 00002000:00010000:0.0:1788845997.369360:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788845997 00010000:00010000:0.0:1788845997.369366:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 9 pid: 8094 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.369379:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 9 pid: 8094 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.369402:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c0861f7/0x1345bc80c773fcc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfff expref: 9 pid: 8094 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.369429:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788845997.369433:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788845997.369439:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.369449:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.369499:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845997.369556:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:2353:x1875740720190720:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 238us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845997.369563:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 78 00010000:00010000:1.0:1788845997.369653:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.369665:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.369703:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.369712:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.369721:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.369728:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01200 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788845997.369732:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.369741:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.369757:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.369764:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c773fcff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845997.369832:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2351:x1875740720190464:12345-192.168.206.48@tcp:1:lfs.0 Request processed in 9039us (9466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845997.369849:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:2.0:1788845997.377766:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845997.377890:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720190976 00000100:00100000:0.0:1788845997.377901:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720190976 00000100:00100000:0.0:1788845997.377965:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:0.0:1788845997.377976:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08dc0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+43:11584:x1875740720190976:12345-192.168.206.48@tcp:35:lfs.0 00000004:00010000:0.0:1788845997.378042:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fcf1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d014 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845997.378507:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788845997.378556:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788845997.378847:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788845997.378900:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.378926:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fcab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff1 expref: 47 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.378935:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.378968:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fcab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff1 expref: 47 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.378983:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fcab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff1 expref: 47 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845997.379011:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348da300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875740739049216:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845997.379094:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845997.381297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.381384:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720191104 00000100:00100000:1.0:1788845997.381392:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720191104 00010000:00010000:1.0:1788845997.381426:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fcab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff1 expref: 48 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845997.381463:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:1.0:1788845997.381473:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+48:2354:x1875740720191104:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845997.381488:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845997.381496:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fcab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff1 expref: 48 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.381510:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fcab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff1 expref: 48 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.381532:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382800) 00010000:00010000:1.0:1788845997.381538:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.381558:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.381565:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.381583:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845997.381631:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+48:2354:x1875740720191104:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 159us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845997.381638:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 79 00010000:00010000:0.0:1788845997.381806:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01c00/0x1345bc80c773fcab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cff1 expref: 47 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845997.381822:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348da300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875740739049216:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788845997.381842:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.381864:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.381870:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845997.381984:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788845997.383337:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788845997.383608:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348da300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875740739049344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788845997.383667:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845997.383700:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788845997.383768:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739049344 00000100:00100000:2.0:1788845997.383776:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739049344 00000100:00100000:2.0:1788845997.383840:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788845997.383849:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875740739049344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788845997.383942:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875740739049344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845997.383950:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788845997.384015:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845997.384080:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348da300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875740739049344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788845997.385311:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788845997.385399:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d60e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875740739049472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788845997.385447:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845997.385537:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788845997.386787:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739049472 00000100:00100000:3.0:1788845997.386798:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739049472 00000100:00100000:3.0:1788845997.386977:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788845997.386988:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1875740739049472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788845997.387226:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5848:x1875740739049472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 239us (1777us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788845997.387236:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788845997.387340:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d60e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875740739049472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788845997.387404:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788845997.387461:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.387472:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.387480:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.387486:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcfa00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845997.387491:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.387498:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.387514:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382800) 00010000:00010000:1.0:1788845997.387516:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788845997.387520:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.387527:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fd06 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845997.387787:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788845997.387895:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788845997.387918:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329604763765ns, next at 330604749669ns, rc = 0 00000001:00080000:1.0:1788845997.387925:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788845997.387960:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382800) 00010000:00010000:1.0:1788845997.387964:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788845997.387970:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475800/0x1345bc80c773fcf1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d014 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845997.388067:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08dc0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+50:11584:x1875740720190976:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 10093us (10308us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788845997.388076:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000020:00080000:1.0:1788845997.388080:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788845997.390430:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.390505:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720191232 00000100:00100000:1.0:1788845997.390515:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720191232 00000100:00100000:1.0:1788845997.390564:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 203 00000100:00100000:1.0:1788845997.390574:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+50:11584:x1875740720191232:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788845997.390597:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845997.390617:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fd0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d01b expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.390671:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fd0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d01b expref: 51 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.390688:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fd0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d01b expref: 51 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.390707:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:1.0:1788845997.390710:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845997.390725:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01200, rc 0) 00000100:00100000:1.0:1788845997.390779:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+51:11584:x1875740720191232:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 206us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845997.390786:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 203 00000100:00100000:2.0:1788845997.393053:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845997.393327:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720191488 00000100:00100000:3.0:1788845997.393337:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720191488 00000100:00100000:3.0:1788845997.393394:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:3.0:1788845997.393403:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+51:11584:x1875740720191488:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1788845997.393636:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+52:11584:x1875740720191488:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 233us (589us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788845997.393644:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:3.0:1788845997.466817:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845997.467695:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720191616 00000100:00100000:0.0:1788845997.467705:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720191616 00000100:00100000:0.0:1788845997.467765:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 204 00000100:00100000:0.0:1788845997.467775:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+52:11594:x1875740720191616:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:0.0:1788845997.467843:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.467868:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.467880:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.467895:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.467902:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.467919:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468004:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773fd22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468013:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773fd22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468019:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773fd22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788845997.468589:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773fd22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468604:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468611:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468738:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468744:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845997.468748:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468756:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468769:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:0.0:1788845997.468772:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845997.468777:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468784:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468798:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468805:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468811:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468816:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845997.468819:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468835:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468844:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c11677400) 00010000:00010000:0.0:1788845997.468847:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845997.468850:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468856:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468870:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773fd22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468877:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773fd22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468882:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773fd22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468887:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788845997.468889:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773fd22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468895:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773fd22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468901:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:0.0:1788845997.468904:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845997.468918:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773fd22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.468933:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773fd22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845997.469075:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+52:11594:x1875740720191616:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 1297us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845997.469084:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 204 00000100:00100000:1.0:1788845997.478309:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c352aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739049600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845997.478379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845997.478507:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739049600 00000100:00100000:2.0:1788845997.478516:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739049600 00000100:00100000:2.0:1788845997.478587:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788845997.478597:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739049600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845997.478647:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788845997.478712:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739049600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845997.478719:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788845997.478772:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c352aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739049600:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788845997.478948:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845997.505715:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845997.505803:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720191872 00000100:00100000:0.0:1788845997.505812:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720191872 00000100:00100000:0.0:1788845997.505875:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 205 00000100:00100000:0.0:1788845997.505885:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c352aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+52:11597:x1875740720191872:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788845997.505904:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845997.505933:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773fd29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d022 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.506015:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.506029:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.506040:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.506055:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.506063:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.506088:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506365:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fd3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506377:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fd3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506386:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fd3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845997.506395:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788845997.506484:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506492:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506498:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506504:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845997.506508:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506515:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506534:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:1.0:1788845997.506537:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845997.506542:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506548:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fd30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506561:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506568:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506573:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506578:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845997.506581:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506587:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506594:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c11677400) 00010000:00010000:1.0:1788845997.506597:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845997.506599:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506606:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fd37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506657:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcf400/0x1345bc80c773fd29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d022 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506671:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fd3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d022 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.506678:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:1.0:1788845997.506680:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845997.506683:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00e00, rc 0) 00000100:00100000:1.0:1788845997.506745:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c352aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+54:11597:x1875740720191872:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 860us (1038us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788845997.506754:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 205 00000100:00100000:3.0:1788845997.509423:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.509809:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720192000 00000100:00100000:1.0:1788845997.509817:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720192000 00000100:00100000:1.0:1788845997.509871:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 206 00000100:00100000:1.0:1788845997.509880:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+54:11597:x1875740720192000:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:1.0:1788845997.509956:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.509971:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.509982:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.510005:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.510028:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.510034:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.510040:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845997.510045:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.510052:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.510064:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:1.0:1788845997.510067:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788845997.510071:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.510077:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845997.510425:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+54:11597:x1875740720192000:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 543us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845997.510433:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 206 00000100:00100000:3.0:1788845997.512222:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.512308:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720192256 00000100:00100000:1.0:1788845997.512317:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720192256 00000100:00100000:1.0:1788845997.512368:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:1.0:1788845997.512377:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+54:11597:x1875740720192256:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1788845997.513077:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+55:11597:x1875740720192256:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 698us (860us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788845997.513100:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:2.0:1788845997.587975:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.588072:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720192512 00000100:00100000:1.0:1788845997.588083:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720192512 00000100:00100000:1.0:1788845997.588191:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 207 00000100:00100000:1.0:1788845997.588217:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+55:11607:x1875740720192512:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788845997.588243:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845997.588246:0:7134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788845997.588270:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fcce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d006 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.588287:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:1.0:1788845997.588292:0:7134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845997.588304:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d029 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.588397:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.588411:0:7134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fd3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d022 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.588419:0:7134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.588465:0:7134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fd3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d022 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.588479:0:7134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fd3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d022 expref: 55 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845997.588507:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d60ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739049728:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788845997.588597:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788845997.591616:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d60ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739049728:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788845997.591649:0:7134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845997.592999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845997.593091:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720192640 00000100:00100000:0.0:1788845997.593100:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720192640 00010000:00010000:0.0:1788845997.593148:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fd3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d022 expref: 56 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845997.593237:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:0.0:1788845997.593248:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+56:2353:x1875740720192640:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845997.593262:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845997.593269:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fd3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d022 expref: 56 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.593281:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fd3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d022 expref: 56 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.593302:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00e00/0x1345bc80c773fd3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d022 expref: 56 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.593318:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:0.0:1788845997.593323:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.593332:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.593339:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.593380:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845997.593432:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+55:2353:x1875740720192640:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 185us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845997.593440:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 80 00010000:00010000:1.0:1788845997.593728:0:7134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.593737:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845997.593755:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788845997.593914:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d029 expref: 56 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.593933:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d029 expref: 55 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.593941:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:1.0:1788845997.593943:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788845997.593946:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00000, rc 0) 00000100:00100000:1.0:1788845997.593974:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+55:11607:x1875740720192512:12345-192.168.206.48@tcp:101:bash.0 Request processed in 5775us (6010us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788845997.593981:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 207 00000100:00100000:3.0:1788845997.598080:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845997.598274:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720192896 00000100:00100000:0.0:1788845997.598283:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720192896 00000100:00100000:0.0:1788845997.598335:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 208 00000100:00100000:0.0:1788845997.598344:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+55:11607:x1875740720192896:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:0.0:1788845997.598586:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773fd68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.598602:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773fd68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.598614:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773fd68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788845997.598664:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788845997.598689:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000853cb782 reply state 00000000ae1a112e transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773fd68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845997.598696:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845997.598772:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+58:11607:x1875740720192896:12345-192.168.206.48@tcp:36:bash.0 Request processed in 428us (699us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788845997.598779:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 208 00000020:00080000:0.0:1788845997.598783:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788845997.600767:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773fd68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.600796:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773fd68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.600803:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773fd68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.600809:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845997.600814:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773fd68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.600822:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773fd68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.600839:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:1.0:1788845997.600842:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845997.600846:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773fd68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.600852:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce200/0x1345bc80c773fd68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845997.602523:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845997.602816:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720193024 00000100:00100000:2.0:1788845997.602839:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720193024 00000100:00100000:2.0:1788845997.602901:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 209 00000100:00100000:2.0:1788845997.602923:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cf69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+57:11607:x1875740720193024:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1788845997.602947:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845997.602967:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fd6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d030 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.603052:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.603067:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d029 expref: 58 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.603078:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.603127:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d029 expref: 58 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.603142:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d029 expref: 58 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845997.603194:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875740739049856:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845997.603272:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b30cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845997.606666:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.606760:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875740739049856:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788845997.606789:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845997.606852:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720193152 00000100:00100000:3.0:1788845997.606858:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720193152 00010000:00010000:3.0:1788845997.606894:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d029 expref: 59 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845997.606941:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:3.0:1788845997.606959:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+59:2354:x1875740720193152:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845997.606973:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845997.606981:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d029 expref: 59 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.606992:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d029 expref: 59 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.607015:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00000/0x1345bc80c773fd5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d029 expref: 59 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.607034:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:3.0:1788845997.607039:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.607047:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.607055:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845997.607244:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845997.607300:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+58:2354:x1875740720193152:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 342us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845997.607307:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 81 00010000:00010000:1.0:1788845997.608124:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.608136:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845997.608256:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788845997.608260:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845997.608282:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.608319:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02825000/0x1345bc80c773fd6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d030 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.608337:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d030 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.608345:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:1.0:1788845997.608347:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845997.608350:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c02824c00, rc 0) 00000100:00100000:1.0:1788845997.608468:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cf69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+57:11607:x1875740720193024:12345-192.168.206.48@tcp:101:bash.0 Request processed in 5548us (5955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845997.608476:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 209 00000100:00100000:2.0:1788845997.612272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845997.612343:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720193408 00000100:00100000:3.0:1788845997.612352:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720193408 00000100:00100000:3.0:1788845997.612398:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:3.0:1788845997.612407:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+57:11607:x1875740720193408:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:3.0:1788845997.612617:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+58:11607:x1875740720193408:12345-192.168.206.48@tcp:35:bash.0 Request processed in 210us (352us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788845997.612625:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:0.0:1788845997.659698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845997.659786:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720193536 00000100:00100000:2.0:1788845997.659796:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720193536 00000100:00100000:2.0:1788845997.659858:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 210 00000100:00100000:2.0:1788845997.659882:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+58:11613:x1875740720193536:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845997.659921:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845997.659949:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773fd7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d037 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.660010:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fd84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.660023:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fd84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.660034:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fd84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845997.660064:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788845997.660068:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845997.660085:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fd84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.660108:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773fd7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d037 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.660141:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fd84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d037 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.660150:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:2.0:1788845997.660205:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845997.660209:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c013c9e00, rc 0) 00000100:00100000:2.0:1788845997.660277:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+59:11613:x1875740720193536:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 397us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845997.660294:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 210 00000100:00100000:2.0:1788845997.663741:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.663829:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720193664 00000100:00100000:1.0:1788845997.663839:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720193664 00000100:00100000:1.0:1788845997.663897:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 211 00000100:00100000:1.0:1788845997.663917:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+59:11613:x1875740720193664:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788845997.663944:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845997.663963:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d03e expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664023:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fd92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664048:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fd92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664060:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fd92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664074:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fd99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664081:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fd99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664087:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fd99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664229:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664238:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664245:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845997.664277:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788845997.664281:0:7134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845997.664298:0:7134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664309:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664328:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fd92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664335:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fd92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664342:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fd92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664348:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845997.664352:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fd92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664359:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fd92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664371:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:1.0:1788845997.664373:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845997.664377:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fd92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664384:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fd92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664397:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fd99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664403:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fd99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664409:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fd99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664422:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845997.664426:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fd99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664432:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fd99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664440:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c10382800) 00010000:00010000:1.0:1788845997.664442:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845997.664445:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fd99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664845:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fd99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664884:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fd8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d03e expref: 61 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664897:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d03e expref: 60 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.664903:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:1.0:1788845997.664917:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845997.664919:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01000, rc 0) 00000100:00100000:1.0:1788845997.664984:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+60:11613:x1875740720193664:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1078us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845997.664992:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 211 00000100:00100000:3.0:1788845997.670612:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845997.670659:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845997.670788:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720193920 00000100:00100000:2.0:1788845997.670798:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720193920 00000100:00100000:2.0:1788845997.670852:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 212 00000100:00100000:2.0:1788845997.670862:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+60:11613:x1875740720193920:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845997.670881:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845997.670902:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773fda7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d045 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.671015:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.671031:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d030 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.671039:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d03e expref: 61 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.671047:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.671082:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d03e expref: 61 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.671094:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d03e expref: 61 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845997.671127:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739049984:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845997.671263:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d030 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.671273:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d030 expref: 61 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845997.671282:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739050112:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845997.671307:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b30cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845997.671848:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720194048 00000100:00100000:0.0:1788845997.671855:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720194048 00010000:00010000:0.0:1788845997.671890:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d03e expref: 62 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845997.671932:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:0.0:1788845997.671949:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c02d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+62:2353:x1875740720194048:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845997.671960:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845997.671966:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d03e expref: 62 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.671979:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d03e expref: 62 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.671998:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:0.0:1788845997.672003:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.672010:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.672016:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845997.672060:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c02d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+62:2353:x1875740720194048:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 120us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845997.672067:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 82 00010000:00010000:2.0:1788845997.675229:0:5846:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.48@tcp) returned -22 from blocking AST (req@000000005338253b x1875740739049984) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d03e expref: 61 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.675252:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fda0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d03e expref: 61 pid: 7134 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845997.675270:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739049984:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845997.675283:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739050112:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845997.675306:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:2.0:1788845997.675311:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.675319:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.675344:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845997.676476:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845997.676805:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720194176 00000100:00100000:2.0:1788845997.676814:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720194176 00010000:00010000:2.0:1788845997.676850:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d030 expref: 61 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845997.676891:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:2.0:1788845997.676901:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+61:2354:x1875740720194176:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845997.676928:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845997.676935:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d030 expref: 61 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.676957:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d030 expref: 61 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.676980:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824c00/0x1345bc80c773fd76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d030 expref: 61 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.676995:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:2.0:1788845997.677000:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.677009:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.677016:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845997.677067:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845997.677117:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+60:2354:x1875740720194176:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 217us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845997.677125:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 83 00010000:00010000:1.0:1788845997.677544:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.677560:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845997.677591:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788845997.677749:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773fda7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d045 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.677766:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d045 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.677774:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:1.0:1788845997.677776:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788845997.677779:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c013c8200, rc 0) 00000100:00100000:1.0:1788845997.677811:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+60:11613:x1875740720193920:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 6950us (7208us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788845997.677818:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 212 00000100:00100000:3.0:1788845997.682140:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845997.682349:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720194432 00000100:00100000:0.0:1788845997.682359:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720194432 00000100:00100000:0.0:1788845997.682419:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:0.0:1788845997.682430:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+60:11613:x1875740720194432:12345-192.168.206.48@tcp:103:lfs.0 00010000:00010000:0.0:1788845997.682444:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845997.682491:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fd0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d01b expref: 60 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845997.682508:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:0.0:1788845997.682512:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845997.682568:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+59:11613:x1875740720194432:12345-192.168.206.48@tcp:103:lfs.0 Request processed in 141us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845997.682577:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1788845997.685082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.685205:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720194560 00000100:00100000:1.0:1788845997.685214:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720194560 00000100:00100000:1.0:1788845997.685271:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 213 00000100:00100000:1.0:1788845997.685281:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+59:11613:x1875740720194560:12345-192.168.206.48@tcp:58:lfs.0 00010000:00010000:1.0:1788845997.685389:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fdbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.685406:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fdbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.685418:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fdbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788845997.685613:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788845997.685695:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+59:11613:x1875740720194560:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 415us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845997.685703:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 213 00000100:00100000:2.0:1788845997.688088:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845997.688327:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720194688 00000100:00100000:1.0:1788845997.688336:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720194688 00000100:00100000:1.0:1788845997.688390:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 214 00000100:00100000:1.0:1788845997.688400:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+59:11613:x1875740720194688:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788845997.688419:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845997.688437:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fdc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d04c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.688498:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fdbc lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.688509:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fdc3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d04c expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.688528:0:5847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fdbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.688541:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fdc3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d04c expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.688555:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:1.0:1788845997.688558:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845997.688561:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fdc3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d04c expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845997.688583:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00c00, rc 0) 00000100:00100000:1.0:1788845997.688644:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+60:11613:x1875740720194688:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 244us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845997.688651:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 214 00010000:00010000:3.0:1788845997.734777:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788845998.073594:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1788845998.073622:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:0.0:1788845998.374435:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845998.374443:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845998.374479:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788845998.374486:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788845998.374596:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348db800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875740739050240:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788845998.374706:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845998.381652:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348db800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875740739050240:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788845998.382808:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.383441:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720194816 00000100:00100000:1.0:1788845998.383627:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720194816 00000100:00100000:2.0:1788845998.383885:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 215 00000100:00100000:2.0:1788845998.383897:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ebde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+60:11614:x1875740720194816:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788845998.383952:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788845998.384069:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ebde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+60:11614:x1875740720194816:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 173us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845998.384078:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 215 00000100:00100000:2.0:1788845998.388246:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.388336:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720194944 00000100:00100000:1.0:1788845998.388346:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720194944 00000100:00100000:1.0:1788845998.388401:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 216 00000100:00100000:1.0:1788845998.388411:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+60:11614:x1875740720194944:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788845998.388477:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fdca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388492:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fdca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388514:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fdca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388531:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773fdd1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388537:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773fdd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388542:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773fdd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388560:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fdd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388579:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fdd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388585:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fdd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845998.388618:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788845998.388622:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788845998.388634:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fdd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388644:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fdca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388650:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fdca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388657:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fdca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388663:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845998.388814:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fdca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388824:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fdca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388836:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f200) 00010000:00010000:1.0:1788845998.388839:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845998.388843:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fdca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388859:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00600/0x1345bc80c773fdca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388874:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773fdd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388880:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773fdd1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388885:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773fdd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388889:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845998.388892:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773fdd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388898:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773fdd1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388920:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9a0c10382900) 00010000:00010000:1.0:1788845998.388923:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845998.388926:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773fdd1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388932:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01800/0x1345bc80c773fdd1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388946:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fdd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388952:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fdd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388966:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fdd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388971:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845998.388974:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fdd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388980:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fdd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388988:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:1.0:1788845998.388990:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845998.388993:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fdd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.388999:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fdd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845998.389079:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+60:11614:x1875740720194944:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 666us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845998.389087:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 216 00000100:00100000:3.0:1788845998.392183:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.392370:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720195200 00000100:00100000:1.0:1788845998.392378:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720195200 00000100:00100000:1.0:1788845998.392542:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 217 00000100:00100000:1.0:1788845998.392554:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+60:11614:x1875740720195200:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845998.392575:0:7134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845998.392595:0:7134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fddf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d053 expref: -99 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.392807:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fde6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.392823:0:7134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fde6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.392834:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fde6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845998.392845:0:7134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788845998.393030:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fde6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.393039:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fde6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.393046:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fde6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.393052:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845998.393056:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fde6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.393063:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fde6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.393076:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:1.0:1788845998.393079:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788845998.393083:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fde6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.393100:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fde6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.393250:0:7134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fddf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d053 expref: 62 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.393261:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f200) 00010000:00010000:1.0:1788845998.393263:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788845998.393268:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fddf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d053 expref: 62 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.393278:0:7134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01200, rc 0) 00000100:00100000:1.0:1788845998.393376:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+61:11614:x1875740720195200:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 824us (1227us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1788845998.393384:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 217 00000100:00100000:3.0:1788845998.398238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.398393:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720195328 00000100:00100000:1.0:1788845998.398403:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720195328 00000100:00100000:1.0:1788845998.398466:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 218 00000100:00100000:1.0:1788845998.398477:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+61:11614:x1875740720195328:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788845998.398510:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788845998.398601:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+61:11614:x1875740720195328:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 126us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845998.398608:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 218 00000100:00100000:2.0:1788845998.402198:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845998.402278:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720195584 00000100:00100000:0.0:1788845998.402288:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720195584 00000100:00100000:0.0:1788845998.402340:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 219 00000100:00100000:0.0:1788845998.402351:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+61:11614:x1875740720195584:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845998.402369:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845998.402371:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788845998.402396:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fd84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d037 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.402415:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:0.0:1788845998.402428:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845998.402441:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fdf4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d05a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788845998.402790:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788845998.402988:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fdfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.403000:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fdfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.403010:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fdfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.403059:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fdf4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d05a expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.403074:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fdfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d05a expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.403082:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a0c11677e00) 00010000:00010000:0.0:1788845998.403084:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788845998.403087:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce600, rc 0) 00000100:00100000:0.0:1788845998.403139:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+62:11614:x1875740720195584:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 790us (948us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788845998.403146:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 219 00000100:00100000:0.0:1788845998.408324:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.408424:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720195840 00000100:00100000:1.0:1788845998.408433:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720195840 00000100:00100000:1.0:1788845998.408502:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 220 00000100:00100000:1.0:1788845998.408526:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+62:11614:x1875740720195840:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788845998.408584:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845998.408613:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce600/0x1345bc80c773fdfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d05a expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.408629:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a0c11677e00) 00010000:00010000:1.0:1788845998.408649:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845998.408668:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fe09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.408680:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fe09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.408689:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fe09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.408700:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa7eff09d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.408706:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7eff09d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.408713:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7eff09d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.408975:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fe09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.408983:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fe09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.409005:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fe09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.409011:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845998.409015:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fe09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.409023:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fe09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.409033:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:1.0:1788845998.409035:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845998.409039:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fe09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.409045:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01200/0x1345bc80c773fe09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.409056:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7eff09d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.409062:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7eff09d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.409067:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7eff09d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.409072:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845998.409074:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7eff09d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.409089:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7eff09d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.409098:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa7eff09d (ffff9a0c10382900) 00010000:00010000:1.0:1788845998.409100:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845998.409103:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa7eff09d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.409109:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa7eff09d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845998.409228:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+61:11614:x1875740720195840:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 703us (912us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788845998.409235:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 220 00000100:00100000:3.0:1788845998.415795:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845998.416022:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720195968 00000100:00100000:0.0:1788845998.416033:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720195968 00000100:00100000:0.0:1788845998.416114:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 221 00000100:00100000:0.0:1788845998.416125:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+61:11614:x1875740720195968:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845998.416144:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845998.416190:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fe17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d061 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.416224:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.416238:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.416250:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.416340:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fe17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d061 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.416357:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d061 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.416366:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:0.0:1788845998.416369:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788845998.416371:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcfa00, rc 0) 00000100:00100000:0.0:1788845998.416435:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+62:11614:x1875740720195968:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 312us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845998.416442:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 221 00000100:00100000:2.0:1788845998.420194:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.420304:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720196224 00000100:00100000:1.0:1788845998.420313:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720196224 00000100:00100000:1.0:1788845998.420372:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 222 00000100:00100000:1.0:1788845998.420382:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+62:11614:x1875740720196224:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788845998.420459:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.420475:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.420488:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788845998.420899:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1788845998.420918:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330637764325ns, next at 331637761297ns, rc = 0 00000004:00010000:1.0:1788845998.421020:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c224be9f reply state 000000008f22cf93 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845998.421029:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788845998.421223:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+64:11614:x1875740720196224:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 840us (1071us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788845998.421230:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 222 00010000:00010000:2.0:1788845998.427761:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.427776:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.427782:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.427786:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845998.427790:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.427812:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.427836:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:2.0:1788845998.427840:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788845998.427846:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.427853:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01000/0x1345bc80c773fe25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845998.428614:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845998.431380:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720196352 00000100:00100000:0.0:1788845998.431399:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720196352 00000100:00100000:0.0:1788845998.431491:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 223 00000100:00100000:0.0:1788845998.431501:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+63:11614:x1875740720196352:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845998.431527:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845998.431547:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fe2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d068 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.431609:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fe2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d068 expref: 64 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.431624:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fe2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d068 expref: 64 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.431644:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:0.0:1788845998.431647:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788845998.431652:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce000, rc 0) 00000100:00100000:0.0:1788845998.431715:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+64:11614:x1875740720196352:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 215us (3106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845998.431722:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 223 00000100:00100000:0.0:1788845998.435794:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845998.435863:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720196480 00000100:00100000:3.0:1788845998.435872:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720196480 00000100:00100000:3.0:1788845998.435973:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:3.0:1788845998.435985:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+9:2351:x1875740720196480:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788845998.436301:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+10:2351:x1875740720196480:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 316us (515us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788845998.436322:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00080000:1.0:1788845998.437130:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845998.438072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845998.438132:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720196736 00000100:00100000:2.0:1788845998.438141:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720196736 00000100:00100000:2.0:1788845998.438211:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:2.0:1788845998.438220:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+64:11614:x1875740720196736:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788845998.438407:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+65:11614:x1875740720196736:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 187us (338us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788845998.438415:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:0.0:1788845998.445824:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.450002:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720196992 00000100:00100000:1.0:1788845998.450015:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720196992 00000100:00100000:1.0:1788845998.450071:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 224 00000100:00100000:1.0:1788845998.450082:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+65:11614:x1875740720196992:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788845998.450235:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+65:11614:x1875740720196992:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 154us (4419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845998.450242:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 224 00000100:00100000:0.0:1788845998.454130:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845998.454968:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720197120 00000100:00100000:2.0:1788845998.454979:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720197120 00000100:00100000:2.0:1788845998.455046:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 225 00000100:00100000:2.0:1788845998.455056:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+65:11614:x1875740720197120:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845998.455075:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845998.455093:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d06f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.455179:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.455205:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.455215:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845998.455248:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845998.455264:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.455290:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d06f expref: 67 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.455307:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d06f expref: 66 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.455314:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:2.0:1788845998.455317:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788845998.455320:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c013c8a00, rc 0) 00000100:00100000:2.0:1788845998.455384:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+66:11614:x1875740720197120:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 329us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845998.455391:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 225 00000100:00100000:3.0:1788845998.458562:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845998.458745:0:8094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720197248 00000100:00100000:2.0:1788845998.458754:0:8094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720197248 00000100:00100000:2.0:1788845998.458810:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:2.0:1788845998.458820:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+10:2353:x1875740720197248:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845998.458839:0:8094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845998.458872:0:8094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d076 expref: -99 pid: 8094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845998.458896:0:8094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9fae, blocks: 0x1 00010000:00010000:2.0:1788845998.458926:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=330s v=(0 0) 00010000:00010000:2.0:1788845998.458932:0:8094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845998.458942:0:8094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d076 expref: 11 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.459014:0:8094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d076 expref: 11 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.459029:0:8094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c013c9a00, rc 0) 00000100:00100000:2.0:1788845998.459254:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4592a189-21d8-449a-9335-07bfe0dc7877+11:2353:x1875740720197248:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 435us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845998.459263:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:0.0:1788845998.461892:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.462020:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720197504 00000100:00100000:1.0:1788845998.462031:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720197504 00000100:00100000:1.0:1788845998.462306:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 226 00000100:00100000:1.0:1788845998.462318:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+66:11614:x1875740720197504:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788845998.462516:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+66:11614:x1875740720197504:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 200us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845998.462524:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 226 00000100:00100000:3.0:1788845998.465723:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.465808:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720197632 00000100:00100000:1.0:1788845998.465817:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720197632 00000100:00100000:1.0:1788845998.465910:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:1.0:1788845998.465921:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+11:11614:x1875740720197632:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788845998.465965:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845998.465984:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074333880/0x1345bc80c773fe48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d07d expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.466015:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d076 expref: 12 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.466024:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845998.466028:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845998.466045:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074333880/0x1345bc80c773fe48 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d07d expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.466078:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d076 expref: 12 pid: 8094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.466091:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d076 expref: 12 pid: 8094 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845998.466105:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d60ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1875740739050368:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788845998.466223:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c04f32900 going to sleep for 11 seconds 00000100:00100000:1.0:1788845998.472921:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d60ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1875740739050368:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788845998.472957:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000074333880/0x1345bc80c773fe48 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d07d expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.472977:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01200, rc 0) 00000100:00100000:1.0:1788845998.473097:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+12:11614:x1875740720197632:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 7177us (7381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845998.473106:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:3.0:1788845998.473369:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845998.473530:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720197760 00000100:00100000:2.0:1788845998.473538:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720197760 00010000:00010000:2.0:1788845998.473571:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d076 expref: 12 pid: 8094 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845998.473639:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:2.0:1788845998.473649:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d529880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+12:2354:x1875740720197760:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845998.473662:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845998.473682:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d076 expref: 12 pid: 8094 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.473707:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d076 expref: 12 pid: 8094 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.473730:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d076 expref: 12 pid: 8094 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.473745:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845998.473749:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845998.473757:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074333880/0x1345bc80c773fe48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d07d expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.473767:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074333880/0x1345bc80c773fe48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d07d expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.473799:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000074333880/0x1345bc80c773fe48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d07d expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845998.473812:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1875740739050496:192.168.206.48@tcp:105: 00000100:00100000:2.0:1788845998.473922:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b0421d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845998.478686:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845998.478911:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720197888 00000100:00100000:3.0:1788845998.478921:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720197888 00002000:00100000:3.0:1788845998.478974:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9a0c3527dc00 x1875740720197888/t0(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:349/0 lens 504/0 e 0 to 0 dl 1788846009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845998.478986:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3527dc00 with x1875740720197888 ext(0->12) 00002000:00010000:3.0:1788845998.478992:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c3527dc00 00000100:00100000:3.0:1788845998.479024:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:3.0:1788845998.479033:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3527dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4592a189-21d8-449a-9335-07bfe0dc7877+12:2353:x1875740720197888:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788845998.479464:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3527dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4592a189-21d8-449a-9335-07bfe0dc7877+14:2353:x1875740720197888:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 Request processed in 431us (786us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788845998.479473:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00002000:00100000:3.0:1788845998.479480:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9a0c3527dc00 x1875740720197888/t4294967320(0) o4->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:349/0 lens 504/448 e 0 to 0 dl 1788846009 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788845998.479488:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c3527dc00 with x1875740720197888 ext(0->12) 00002000:00010000:3.0:1788845998.479492:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c3527dc00 00000100:00100000:0.0:1788845998.481718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845998.481798:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720198016 00000100:00100000:3.0:1788845998.481806:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720198016 00000100:00100000:3.0:1788845998.481860:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 227 00000100:00100000:3.0:1788845998.481870:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c088de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+66:11614:x1875740720198016:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788845998.485005:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1875740739050496:192.168.206.48@tcp:105: 00010000:00010000:2.0:1788845998.485028:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845998.485579:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d529880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4592a189-21d8-449a-9335-07bfe0dc7877+13:2354:x1875740720197760:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 11927us (12207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845998.485591:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:2.0:1788845998.508414:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c088de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+66:11614:x1875740720198016:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 26536us (26694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845998.508426:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 227 00000001:00080000:1.0:1788845998.508510:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000001:00080000:1.0:1788845998.508540:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1788845998.508545:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:1.0:1788845998.508574:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788845998.508593:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a0c1167b780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788845998.508597:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c02b53100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c1167b600 00000020:00080000:1.0:1788845998.508600:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c02b53e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c34fd2000 00000001:00080000:1.0:1788845998.508628:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788845998.508638:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788845998.508666:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a0c200aec00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788845998.508669:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c3ebac400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c200ae3c0 00000020:00080000:1.0:1788845998.508672:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0c3ebacd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c3cf64800 00000020:00080000:1.0:1788845998.508683:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788845998.508851:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788845998.509020:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845998.509034:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739050624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788845998.509083:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845998.509116:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845998.509125:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739050752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788845998.509147:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845998.509190:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739050624 00000100:00100000:2.0:1788845998.509197:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739050624 00000100:00100000:2.0:1788845998.509226:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739050752 00000100:00100000:2.0:1788845998.509229:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739050752 00000100:00100000:2.0:1788845998.509249:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788845998.509257:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3307:x1875740739050624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788845998.509279:0:11681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1788845998.509301:0:11681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.509322:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fbe57a67/0x1345bc80c773fc11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfdc expref: 12 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.509331:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788845998.509335:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788845998.509339:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.509366:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fbe57a67/0x1345bc80c773fc11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfdc expref: 12 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.509394:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fbe57a67/0x1345bc80c773fc11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfdc expref: 12 pid: 11681 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845998.509405:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11681:1875740739050880:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845998.509448:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c0971b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788845998.509465:0:8094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788845998.509473:0:8094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1875740739050752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788845998.509584:0:8094:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788845998.509588:0:8094:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788845998 00002000:00010000:2.0:1788845998.509590:0:8094:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788845998.509592:0:8094:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788845998 -> 1788845998 00002000:00010000:2.0:1788845998.509594:0:8094:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788845998.509629:0:8094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3310:x1875740739050752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (480us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788845998.509636:0:8094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1788845998.509673:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a0c348d5180/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788845998.509679:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739050752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788845998.510292:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845998.512235:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845998.512339:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845998.512636:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720198144 00000100:00100000:3.0:1788845998.512645:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720198144 00010000:00010000:3.0:1788845998.512681:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fbe57a67/0x1345bc80c773fc11 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfdc expref: 13 pid: 11681 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845998.512720:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:3.0:1788845998.512730:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c26321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+13:2354:x1875740720198144:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845998.512745:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845998.512751:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fbe57a67/0x1345bc80c773fc11 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfdc expref: 13 pid: 11681 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.512763:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fbe57a67/0x1345bc80c773fc11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfdc expref: 13 pid: 11681 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.512787:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845998.512791:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788845998.512797:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.512807:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.512826:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845998.512873:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c26321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+13:2354:x1875740720198144:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 144us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845998.512880:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 85 00010000:00010000:2.0:1788845998.513248:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbe57a67/0x1345bc80c773fc11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfdc expref: 12 pid: 11681 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845998.513266:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11681:1875740739050880:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845998.513286:0:11681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.513309:0:11681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.513316:0:11681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.513325:0:11681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.513333:0:11681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.513358:0:11681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788845998.514086:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3307:x1875740739050624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4825us (4999us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788845998.514095:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788845998.514116:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720198272 00000100:00100000:2.0:1788845998.514121:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720198272 00000100:00100000:2.0:1788845998.514193:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:2.0:1788845998.514202:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4592a189-21d8-449a-9335-07bfe0dc7877+12:2353:x1875740720198272:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1788845998.514544:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845998.514559:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.514571:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c9a00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788845998.514575:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.514584:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.514602:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.514609:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054be2831/0x1345bc80c773fe4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.514629:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845998.514631:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845998.514633:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845998.514746:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739051008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788845998.514790:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845998.514823:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739051008 00000100:00100000:1.0:1788845998.514828:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739051008 00000100:00100000:1.0:1788845998.514854:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788845998.514861:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739051008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788845998.514876:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1788845998.514912:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f9fad, atime: 0x6a9f9fad, ctime: 0x6a9f9fad, blocks: 0xb 00010000:00010000:1.0:1788845998.514925:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c773fe56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.514937:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1788845998.514941:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788845998.514947:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c773fe56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.514959:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c773fe56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.514967:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c773fe56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.514975:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c773fe56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.514989:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788845998.515435:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875740739051008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 573us (643us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788845998.515443:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:1.0:1788845998.515485:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845998.515490:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c773fe56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.515499:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788845998.515503:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c773fe56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.515517:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c773fe56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.515530:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c773fe56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.515537:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c773fe56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.515551:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845998.515552:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845998.515554:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845998.515579:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1788845998.515585:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a0c3eb4ce00, transno 4294967307 00000004:00080000:1.0:1788845998.515596:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:1.0:1788845998.515616:0:3309:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9a0c348d7800 x1875740739051008/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788846014 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788845998.515627:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a0c348d7800/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788845998.515632:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739051008:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788845998.516083:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a0c348d7b80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788845998.516090:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739050624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788845998.541773:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4592a189-21d8-449a-9335-07bfe0dc7877+12:2353:x1875740720198272:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 27560us (29422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845998.541786:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00000001:00080000:3.0:1788845998.542277:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1788845998.542289:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1788845998.542300:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1788845998.545010:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845998.545096:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720198528 00000100:00100000:2.0:1788845998.545127:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720198528 00000100:00100000:2.0:1788845998.545220:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 228 00000100:00100000:2.0:1788845998.545231:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+20:11614:x1875740720198528:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788845998.545280:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845998.545308:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d06f expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.545325:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:2.0:1788845998.545329:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845998.545356:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.545368:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.545378:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845998.545607:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2af8ca2 reply state 00000000bb7203e9 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845998.545616:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845998.545709:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+21:11614:x1875740720198528:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 480us (705us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788845998.545717:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 228 00010000:00010000:1.0:1788845998.551189:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.551206:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.551213:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.551231:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c9e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845998.551236:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.551243:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.551259:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:1.0:1788845998.551262:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845998.551266:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.551272:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845998.553343:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.553530:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720198656 00000100:00100000:1.0:1788845998.553539:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720198656 00000100:00100000:1.0:1788845998.553590:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:1.0:1788845998.553600:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2351:x1875740720198656:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788845998.553833:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788845998.553837:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788845998 -> 1788845997 00002000:00010000:1.0:1788845998.553840:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788845997 00002000:00010000:1.0:1788845998.553842:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788845998 -> 1788845997 00002000:00010000:1.0:1788845998.553844:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788845998.553913:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:2351:x1875740720198656:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 303us (568us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788845998.553921:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:0.0:1788845998.556131:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.556353:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720198912 00000100:00100000:1.0:1788845998.556374:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720198912 00000100:00100000:1.0:1788845998.556425:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 229 00000100:00100000:1.0:1788845998.556435:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+20:11614:x1875740720198912:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788845998.556504:0:7134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.556520:0:7134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d061 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.556530:0:7134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.556563:0:7134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d061 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.556576:0:7134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d061 expref: 20 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845998.556589:0:7134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d60e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739051136:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788845998.556881:0:7134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1167b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788845998.558954:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.559149:0:7134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d60e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7134:1875740739051136:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788845998.559208:0:7134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845998.559365:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720199040 00000100:00100000:0.0:1788845998.559372:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720199040 00010000:00010000:0.0:1788845998.559410:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d061 expref: 21 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845998.559458:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:0.0:1788845998.559483:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+21:2353:x1875740720199040:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845998.559498:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845998.559505:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d061 expref: 21 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.559516:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d061 expref: 21 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.559539:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d061 expref: 21 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.559553:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:0.0:1788845998.559558:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.559567:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.559575:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.559603:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845998.559659:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+20:2353:x1875740720199040:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 178us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845998.559667:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 86 00010000:00010000:1.0:1788845998.560138:0:7134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.560148:0:7134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.560217:0:7134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.560225:0:7134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.560231:0:7134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.560237:0:7134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01600 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845998.560241:0:7134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.560248:0:7134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.560258:0:7134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:1.0:1788845998.560261:0:7134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788845998.560265:0:7134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.560271:0:7134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01600/0x1345bc80c773fe64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845998.560317:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+19:11614:x1875740720198912:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 Request processed in 3883us (4192us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788845998.560324:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 229 00000100:00100000:3.0:1788845998.562694:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845998.562930:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720199168 00000100:00100000:0.0:1788845998.562950:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720199168 00000100:00100000:0.0:1788845998.563000:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:0.0:1788845998.563012:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+8:2351:x1875740720199168:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788845998.563068:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.563089:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074333880/0x1345bc80c773fe48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d07d expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.563099:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788845998.563102:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788845998.563107:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.563141:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074333880/0x1345bc80c773fe48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d07d expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.563181:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074333880/0x1345bc80c773fe48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d07d expref: 8 pid: 6690 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845998.563195:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1875740739051264:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788845998.563318:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c0675d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788845998.565536:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1875740739051264:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788845998.565569:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845998.567343:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845998.567708:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720199296 00000100:00100000:0.0:1788845998.567717:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720199296 00010000:00010000:0.0:1788845998.567760:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074333880/0x1345bc80c773fe48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d07d expref: 9 pid: 6690 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845998.567797:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:0.0:1788845998.567808:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+9:2353:x1875740720199296:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845998.567835:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845998.567856:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074333880/0x1345bc80c773fe48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d07d expref: 9 pid: 6690 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.567868:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074333880/0x1345bc80c773fe48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d07d expref: 9 pid: 6690 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.567890:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074333880/0x1345bc80c773fe48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d07d expref: 9 pid: 6690 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.567918:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788845998.567922:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788845998.567927:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.567943:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.567975:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845998.568203:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.568213:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.568237:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.568245:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.568253:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.568260:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce800 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788845998.568264:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.568272:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.568284:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.568302:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c259fe6/0x1345bc80c773fe6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845998.568535:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:2353:x1875740720199296:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 727us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845998.568543:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:1.0:1788845998.568685:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+7:2351:x1875740720199168:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 5675us (5999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845998.568693:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:0.0:1788845998.571022:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845998.571280:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720199552 00000100:00100000:2.0:1788845998.571289:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720199552 00000100:00100000:2.0:1788845998.571341:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 230 00000100:00100000:2.0:1788845998.571352:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+19:11614:x1875740720199552:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788845998.571439:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fe72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.571522:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fe72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.571534:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fe72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.571725:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.571737:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fe2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d068 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.571744:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.571777:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fe2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d068 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.571791:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fe2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d068 expref: 20 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845998.571805:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739051392:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845998.571940:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c0971b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845998.574911:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845998.575444:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720199680 00000100:00100000:0.0:1788845998.575462:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720199680 00010000:00010000:0.0:1788845998.575506:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fe2c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d068 expref: 21 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845998.575558:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:0.0:1788845998.575568:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c02d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+21:2353:x1875740720199680:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845998.575583:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845998.575591:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fe2c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d068 expref: 21 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.575604:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fe2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d068 expref: 21 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.575624:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:0.0:1788845998.575630:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.575639:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.575647:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.575669:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845998.575867:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c02d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4592a189-21d8-449a-9335-07bfe0dc7877+21:2353:x1875740720199680:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 300us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845998.575876:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 88 00010000:00010000:1.0:1788845998.576125:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebce000/0x1345bc80c773fe2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d068 expref: 20 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845998.576144:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739051392:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788845998.576182:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.576192:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.576198:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788845998.576356:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788845998.576602:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788845998.576651:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788845998.576732:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d60e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1875740739051520:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788845998.576780:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845998.576808:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c053add80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845998.578307:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739051520 00000100:00100000:3.0:1788845998.578318:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739051520 00000100:00100000:2.0:1788845998.578570:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845998.578583:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875740739051520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788845998.578699:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875740739051520:12345-0@lo:1000:mdt00_001.0 Request processed in 120us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845998.578707:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788845998.578767:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1788845998.578773:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:1.0:1788845998.578799:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a0c348d5180, transno 4294967321 00000004:00080000:1.0:1788845998.578815:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a0c348d7b80, transno 4294967322 00000100:00100000:1.0:1788845998.578823:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d60e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1875740739051520:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788845998.579338:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788845998.579409:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d60e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1875740739051648:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788845998.579462:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845998.580256:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c053ad3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845998.580342:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739051648 00000100:00100000:0.0:1788845998.580350:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739051648 00000100:00100000:0.0:1788845998.580389:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788845998.580398:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d60f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875740739051648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788845998.580684:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d60f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875740739051648:12345-0@lo:1000:mdt00_001.0 Request processed in 286us (1220us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788845998.580692:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788845998.580806:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d60e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1875740739051648:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788845998.580840:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.580849:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.580857:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.580863:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c8a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845998.580867:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.580875:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.580889:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a0c11677000) 00010000:00010000:1.0:1788845998.580892:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845998.580897:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.580914:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773fe79 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.581023:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fdbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.581031:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fdbc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.581037:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fdbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.581042:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788845998.581045:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fdbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.581051:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fdbc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.581060:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:1.0:1788845998.581063:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845998.581069:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fdc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d04c expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.581080:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fdc3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d04c expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.581089:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fdc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d04c expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845998.581119:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fdc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d04c expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845998.581143:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d67f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739051776:192.168.206.48@tcp:105: 00000100:00100000:1.0:1788845998.581316:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c053ad3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845998.586957:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788845998.587803:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720199808 00000100:00100000:0.0:1788845998.587814:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720199808 00000100:00100000:0.0:1788845998.587878:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:0.0:1788845998.587889:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+24:11613:x1875740720199808:12345-192.168.206.48@tcp:49:lfs.0 00000100:00100000:0.0:1788845998.588039:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+24:11613:x1875740720199808:12345-192.168.206.48@tcp:49:lfs.0 Request processed in 153us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845998.588047:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:0.0:1788845998.589957:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845998.590031:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720200064 00000100:00100000:3.0:1788845998.590040:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720200064 00000100:00100000:3.0:1788845998.590086:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 231 00000100:00100000:3.0:1788845998.590095:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+24:11613:x1875740720200064:12345-192.168.206.48@tcp:58:lfs.0 00000040:00080000:3.0:1788845998.590611:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788845998.590721:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+24:11613:x1875740720200064:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 625us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845998.590729:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 231 00000100:00100000:2.0:1788845998.590887:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d67f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875740739051776:192.168.206.48@tcp:105: 00010000:00010000:2.0:1788845998.590925:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fdbc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.590944:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00400/0x1345bc80c773fdbc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.590975:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.590989:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591000:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591010:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591017:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe80 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591024:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591029:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c9e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845998.591033:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591052:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe80 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591064:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:2.0:1788845998.591067:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845998.591071:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe80 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591076:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fe80 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591088:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fe72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591094:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fe72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591100:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fe72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591105:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c9c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845998.591108:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fe72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591115:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fe72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591122:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:2.0:1788845998.591125:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788845998.591127:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fe72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.591143:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fe72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845998.591268:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+23:11614:x1875740720199552:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 19918us (20254us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788845998.591276:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 230 00000020:00080000:2.0:1788845998.591280:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788845998.591476:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845998.591480:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845998.591511:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788845998.591515:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788845998.591604:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875740739051904:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788845998.591650:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c0675da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788845998.598604:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.598744:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845998.599017:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11678:1875740739051904:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788845998.599198:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720200448 00000100:00100000:2.0:1788845998.599204:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720200448 00000100:00100000:2.0:1788845998.599243:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 232 00000100:00100000:2.0:1788845998.599251:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+23:11615:x1875740720200448:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788845998.599281:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788845998.599369:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+23:11615:x1875740720200448:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 117us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845998.599376:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 232 00000100:00100000:0.0:1788845998.599670:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720200320 00000100:00100000:0.0:1788845998.599675:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720200320 00000100:00100000:0.0:1788845998.599714:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:0.0:1788845998.599721:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08dc1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+23:11614:x1875740720200320:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788845998.600437:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788845998.600631:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788845998.600681:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.600698:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.600717:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.600726:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe87 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.600732:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe87 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.600737:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845998.600754:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788845998.600830:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08dc1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+25:11614:x1875740720200320:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 1107us (2231us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788845998.600839:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00000020:00080000:0.0:1788845998.600843:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788845998.601078:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845998.601085:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.601092:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcfa00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:2.0:1788845998.601095:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.601103:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.601130:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a0c11677900) 00010000:00010000:2.0:1788845998.601133:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788845998.601138:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe87 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.601144:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfa00/0x1345bc80c773fe87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.601177:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845998.601179:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845998.601181:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845998.608826:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788845998.609076:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720200704 00000100:00100000:3.0:1788845998.609085:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720200704 00000100:00100000:3.0:1788845998.609144:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 233 00000100:00100000:3.0:1788845998.609186:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+25:11615:x1875740720200704:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788845998.609210:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845998.609230:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fe8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d084 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.609328:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fe95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.609355:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fe95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.609366:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fe95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845998.609379:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788845998.609508:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01474200/0x1345bc80c773fe8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d084 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.609527:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fe95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d084 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.609536:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:3.0:1788845998.609539:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788845998.609542:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475a00, rc 0) 00000100:00100000:3.0:1788845998.609592:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+27:11615:x1875740720200704:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 440us (774us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788845998.609600:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 233 00000100:00100000:1.0:1788845998.617856:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845998.617941:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720200960 00000100:00100000:2.0:1788845998.617951:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720200960 00000100:00100000:2.0:1788845998.618009:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 234 00000100:00100000:2.0:1788845998.618019:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+27:11615:x1875740720200960:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788845998.618093:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fea3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.618110:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fea3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.618122:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fea3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.618323:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fea3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.618331:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fea3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.618352:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fea3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.618358:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c9c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845998.618363:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fea3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.618370:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fea3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.618382:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:2.0:1788845998.618386:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788845998.618390:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fea3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.618397:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fea3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845998.618759:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+28:11615:x1875740720200960:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 740us (909us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788845998.618769:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 234 00000040:00080000:0.0:1788845998.618920:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845998.618924:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845998.619428:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788845998.619437:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788845998.625884:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.625976:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720201216 00000100:00100000:1.0:1788845998.625986:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720201216 00000100:00100000:1.0:1788845998.626038:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:1.0:1788845998.626047:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+28:11615:x1875740720201216:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788845998.626289:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+29:11615:x1875740720201216:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 243us (413us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788845998.626296:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:3.0:1788845998.627426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845998.627639:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720201344 00000100:00100000:2.0:1788845998.627647:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720201344 00000100:00100000:2.0:1788845998.627695:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 235 00000100:00100000:2.0:1788845998.627704:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+29:11617:x1875740720201344:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788845998.627721:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845998.627741:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773feaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d08b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.627816:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773feb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.627831:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773feb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.627843:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773feb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.627859:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773feb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.627866:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773feb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.627874:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773feb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.628218:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773febf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.628230:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d045 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.628239:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773febf lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.628270:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d045 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.628294:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d045 expref: 30 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845998.628308:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875740739052032:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788845998.628423:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c0971b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845998.634894:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845998.635062:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720201600 00000100:00100000:1.0:1788845998.635070:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720201600 00000100:00100000:1.0:1788845998.635133:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:1.0:1788845998.635143:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+31:5589:x1875740720201600:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788845998.635392:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+32:5589:x1875740720201600:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 249us (506us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788845998.635400:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:1.0:1788845998.638207:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845998.638345:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875740739052032:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788845998.638370:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773febf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845998.638438:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720201728 00000100:00100000:3.0:1788845998.638454:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720201728 00010000:00010000:3.0:1788845998.638498:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d045 expref: 32 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845998.638532:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00100000:3.0:1788845998.638541:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d675c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+32:2354:x1875740720201728:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845998.638569:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845998.638576:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d045 expref: 32 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.638589:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d045 expref: 32 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.638610:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fdae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d045 expref: 32 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.638627:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:3.0:1788845998.638632:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773febf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.638642:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773febf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.638649:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773febf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845998.638679:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845998.638731:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d675c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4592a189-21d8-449a-9335-07bfe0dc7877+31:2354:x1875740720201728:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 190us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845998.638739:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 89 00010000:00010000:2.0:1788845998.638824:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773febf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.638832:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773febf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845998.638867:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788845998.638871:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788845998.638887:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773febf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.638907:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773febf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.638915:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773feb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.638922:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773feb1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.638949:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773feb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.638955:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c9e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845998.638959:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773feb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.638967:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773feb1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.638976:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:2.0:1788845998.638978:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845998.638982:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773feb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.638988:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773feb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.638999:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773feb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.639005:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773feb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.639011:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773feb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.639016:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c9a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845998.639019:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773feb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.639033:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773feb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.639041:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a0c04c4fa00) 00010000:00010000:2.0:1788845998.639043:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845998.639045:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773feb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.639051:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9a00/0x1345bc80c773feb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.639078:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773feaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d08b expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.639090:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773febf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d08b expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845998.639096:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:2.0:1788845998.639099:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788845998.639101:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c013c8a00, rc 0) 00000100:00100000:2.0:1788845998.639123:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+30:11617:x1875740720201344:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 11421us (11703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845998.639130:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 235 00010000:00010000:1.0:1788845998.758760:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788845999.375388:0:12612:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845999.375395:0:12612:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788845999.375444:0:12612:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788845999.375450:0:12612:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788845999.497426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845999.497530:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720201984 00000100:00100000:1.0:1788845999.497550:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720201984 00000100:00100000:1.0:1788845999.497627:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 236 00000100:00100000:1.0:1788845999.497637:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+30:11640:x1875740720201984:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788845999.497658:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845999.497677:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fec6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d092 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845999.497772:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fecd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845999.497787:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845999.497799:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845999.497809:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788845999.497931:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00200/0x1345bc80c773fec6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d092 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845999.497947:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d092 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845999.497956:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:1.0:1788845999.497959:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788845999.497962:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a01400, rc 0) 00000100:00100000:1.0:1788845999.498012:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4592a189-21d8-449a-9335-07bfe0dc7877+32:11640:x1875740720201984:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 377us (596us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788845999.498020:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 236 00000100:00080000:2.0:1788845999.499724:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845999.499857:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845999.500010:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720202112 00000100:00100000:2.0:1788845999.500019:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720202112 00000100:00100000:2.0:1788845999.501035:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 237 00000100:00100000:2.0:1788845999.501054:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+32:11640:x1875740720202112:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:2.0:1788845999.501518:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fedb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.501536:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.501547:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.501571:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.501579:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fedb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.501586:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fedb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.501592:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c9e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788845999.501596:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fedb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.501603:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fedb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.501613:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:2.0:1788845999.501615:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788845999.501619:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fedb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.501625:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9e00/0x1345bc80c773fedb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845999.501698:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4592a189-21d8-449a-9335-07bfe0dc7877+32:11640:x1875740720202112:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 649us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845999.501706:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 237 00000100:00100000:2.0:1788845999.529053:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739052160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845999.529548:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845999.529619:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739052160 00000100:00100000:2.0:1788845999.529626:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739052160 00000100:00100000:2.0:1788845999.529681:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788845999.529691:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739052160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845999.529721:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788845999.529735:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845999.530535:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739052160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 844us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845999.530544:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788845999.530767:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739052160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845999.531298:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739052288:0@lo:400:kworker.0 00000100:00100000:3.0:1788845999.531348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845999.532256:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739052288 00000100:00100000:0.0:1788845999.532265:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739052288 00000100:00100000:0.0:1788845999.532313:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788845999.532321:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739052288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845999.532376:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739052288:12345-0@lo:400:kworker.0 Request processed in 56us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845999.532383:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788845999.532502:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739052288:0@lo:400:kworker.0 00000100:00100000:0.0:1788845999.534504:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739052416:0@lo:400:kworker.0 00000100:00100000:0.0:1788845999.534562:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845999.534593:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845999.534600:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739052544:0@lo:400:kworker.0 00000100:00100000:0.0:1788845999.534622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845999.535527:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739052416 00000100:00100000:3.0:1788845999.535542:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739052416 00000100:00100000:3.0:1788845999.535593:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739052544 00000100:00100000:3.0:1788845999.535597:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739052544 00000100:00100000:3.0:1788845999.535629:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788845999.535638:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739052416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845999.535707:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739052416:12345-0@lo:400:kworker.0 Request processed in 70us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845999.535715:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788845999.535730:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788845999.535736:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739052544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845999.535763:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739052544:12345-0@lo:400:kworker.0 Request processed in 28us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845999.535770:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1788845999.535785:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845999.535816:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739052544:0@lo:400:kworker.0 00000100:00100000:3.0:1788845999.535828:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739052416:0@lo:400:kworker.0 00000100:00100000:2.0:1788845999.536181:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739052800:0@lo:400:kworker.0 00000100:00100000:2.0:1788845999.536219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845999.536243:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845999.536250:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739052672:0@lo:400:kworker.0 00000100:00100000:2.0:1788845999.536275:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845999.536298:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739052800 00000100:00100000:2.0:1788845999.536303:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739052800 00000100:00100000:2.0:1788845999.536341:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788845999.536349:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739052800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845999.536383:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739052800:12345-0@lo:400:kworker.0 Request processed in 35us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845999.536389:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788845999.536418:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739052672 00000100:00100000:2.0:1788845999.536422:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739052672 00000100:00080000:3.0:1788845999.538823:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845999.538832:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845999.538886:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739052800:0@lo:400:kworker.0 00000100:00100000:2.0:1788845999.539043:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788845999.539056:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3308:x1875740739052672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845999.539129:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3308:x1875740739052672:12345-0@lo:400:kworker.0 Request processed in 77us (2853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845999.539137:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788845999.539328:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739052672:0@lo:400:kworker.0 00000100:00100000:1.0:1788845999.575984:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788845999.576124:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720202240 00000100:00100000:2.0:1788845999.576133:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720202240 00000100:00100000:2.0:1788845999.576214:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:2.0:1788845999.576223:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+7:2354:x1875740720202240:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:2.0:1788845999.576238:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845999.576256:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062e9b86f/0x1345bc80c773fee2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d099 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788845999.576282:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f9fad, atime: 0x6a9f9fad, ctime: 0x6a9f9fad, blocks: 0xb 00010000:00010000:2.0:1788845999.576303:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1788845999.576308:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845999.576317:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062e9b86f/0x1345bc80c773fee2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d099 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.576335:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000062e9b86f/0x1345bc80c773fee2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d099 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.576347:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c013c9e00, rc 0) 00000100:00100000:2.0:1788845999.576402:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:2354:x1875740720202240:12345-192.168.206.48@tcp:101:cat.0 Request processed in 179us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845999.576423:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:2.0:1788845999.590825:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788845999.590961:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720202368 00000100:00100000:1.0:1788845999.590970:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720202368 00002000:00100000:1.0:1788845999.591015:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9a0c348d4700 x1875740720202368/t0(0) o3->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:350/0 lens 488/0 e 0 to 0 dl 1788846010 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788845999.591026:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c348d4700 with x1875740720202368 ext(0->4095) 00002000:00010000:1.0:1788845999.591031:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c348d4700 00000100:00100000:1.0:1788845999.591118:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1788845999.591129:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:2351:x1875740720202368:12345-192.168.206.48@tcp:3:cat.0 00000100:00100000:1.0:1788845999.591364:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4592a189-21d8-449a-9335-07bfe0dc7877+8:2351:x1875740720202368:12345-192.168.206.48@tcp:3:cat.0 Request processed in 235us (546us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788845999.591372:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00002000:00100000:1.0:1788845999.591380:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9a0c348d4700 x1875740720202368/t0(0) o3->4592a189-21d8-449a-9335-07bfe0dc7877@192.168.206.48@tcp:350/0 lens 488/4536 e 0 to 0 dl 1788846010 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788845999.591388:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a0c348d4700 with x1875740720202368 ext(0->4095) 00002000:00010000:1.0:1788845999.591392:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a0c348d4700 00010000:00010000:1.0:1788845999.782388:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846000.028660:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846000.028745:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720202624 00000100:00100000:0.0:1788846000.028753:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720202624 00000100:00100000:0.0:1788846000.028815:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:0.0:1788846000.028826:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d677800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2354:x1875740720202624:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788846000.028907:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d677800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2354:x1875740720202624:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 84us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846000.028914:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00080000:3.0:1788846000.029145:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788846000.034289:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846000.034328:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846000.034861:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720202496 00000100:00100000:3.0:1788846000.034870:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720202496 00000100:00100000:3.0:1788846000.034943:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 288 00000100:00100000:3.0:1788846000.034952:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:2353:x1875740720202496:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788846000.035023:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a77a96b-0efb-4559-b734-596c51917804+13:2353:x1875740720202496:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 72us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846000.035042:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 288 00000100:00100000:0.0:1788846000.036016:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720202752 00000100:00100000:0.0:1788846000.036024:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720202752 00000100:00100000:0.0:1788846000.036087:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00100000:0.0:1788846000.036099:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8450d7e-d658-40b4-8296-b4731edf9929+5:2353:x1875740720202752:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788846000.036179:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8450d7e-d658-40b4-8296-b4731edf9929+5:2353:x1875740720202752:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 84us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846000.036187:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00080000:3.0:1788846000.036499:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788846000.809566:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846001.833328:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846002.600687:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788846002.600709:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739052928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788846002.600772:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846002.600833:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739052928 00000100:00100000:0.0:1788846002.600841:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739052928 00000100:00100000:0.0:1788846002.600926:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788846002.600938:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875740739052928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788846002.600969:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788846002.601016:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875740739052928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846002.601024:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788846002.601072:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739052928:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788846002.601579:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788846002.854363:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788846003.153255:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:2.0:1788846003.187119:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846003.187246:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720202880 00000100:00100000:3.0:1788846003.187267:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720202880 00000100:00100000:3.0:1788846003.187340:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 238 00000100:00100000:3.0:1788846003.187351:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+32:11293:x1875740720202880:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788846003.187467:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4592a189-21d8-449a-9335-07bfe0dc7877+32:11293:x1875740720202880:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 Request processed in 119us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846003.187475:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 238 00000100:00080000:2.0:1788846003.187605:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846003.192751:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846003.196064:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720203136 00000100:00100000:1.0:1788846003.196076:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720203136 00000100:00100000:2.0:1788846003.196247:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:2.0:1788846003.196270:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+32:11293:x1875740720203136:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788846003.196510:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+33:11293:x1875740720203136:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 242us (3768us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788846003.196518:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:0.0:1788846003.400341:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846003.400603:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720203264 00000100:00100000:2.0:1788846003.400612:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720203264 00000100:00100000:2.0:1788846003.400696:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 239 00000100:00100000:2.0:1788846003.400706:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8450d7e-d658-40b4-8296-b4731edf9929+5:12093:x1875740720203264:12345-192.168.206.48@tcp:101:lsof.0 00010000:00010000:2.0:1788846003.400724:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846003.400742:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d0a0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.400832:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fef0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.400846:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.400857:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846003.400900:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788846003.400904:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000100:00080000:3.0:1788846003.401055:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1788846003.401103:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.401128:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8200/0x1345bc80c773fee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0a0 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.401145:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fef0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0a0 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.401207:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382100) 00010000:00010000:2.0:1788846003.401210:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846003.401213:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c013c9c00, rc 0) 00000100:00100000:2.0:1788846003.401275:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8450d7e-d658-40b4-8296-b4731edf9929+6:12093:x1875740720203264:12345-192.168.206.48@tcp:101:lsof.0 Request processed in 570us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846003.401282:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 239 00000001:00080000:3.0:1788846003.657230:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1788846003.657244:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1788846003.660040:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000001:00080000:1.0:1788846003.660260:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788846003.660272:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a0c053ad600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788846003.660280:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0b010a1600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c053add80 00000020:00080000:1.0:1788846003.660283:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a0b010a1300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a0c110ee800 00000020:00080000:1.0:1788846003.660303:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788846003.660320:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000001:00080000:1.0:1788846003.660382:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788846003.660500:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788846003.879085:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846004.646443:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739053056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846004.646521:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846004.646588:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788846004.646592:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740739053312:0@lo:400:kworker.0 00000100:00100000:1.0:1788846004.646598:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740739053440:0@lo:400:kworker.0 00000100:00100000:0.0:1788846004.646689:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739053056 00000100:00100000:0.0:1788846004.646697:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739053056 00000100:00100000:0.0:1788846004.646748:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788846004.646760:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739053056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788846004.646792:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788846004.646881:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788846004.646905:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739053184:0@lo:400:kworker.0 00000100:00100000:1.0:1788846004.653685:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846004.653754:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739053568:0@lo:400:kworker.0 00000100:00100000:1.0:1788846004.653798:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846004.653843:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739053440 00000100:00100000:1.0:1788846004.653850:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739053440 00000100:00100000:1.0:1788846004.653911:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788846004.653920:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740739053440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846004.653972:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740739053440:12345-0@lo:400:kworker.0 Request processed in 53us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846004.653979:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788846004.654000:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739053568 00000100:00100000:1.0:1788846004.654003:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739053568 00000100:00100000:1.0:1788846004.654028:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788846004.654033:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c077ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739053568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846004.654698:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c077ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739053568:12345-0@lo:400:kworker.0 Request processed in 661us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846004.654706:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788846004.654846:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788846004.654851:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846004.654892:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788846004.654898:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788846004.654915:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739053568:0@lo:400:kworker.0 00000100:00100000:1.0:1788846004.654929:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740739053440:0@lo:400:kworker.0 00000100:00100000:0.0:1788846004.655134:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d677100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739053056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8376us (8612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846004.655144:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788846004.655245:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846004.655311:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788846004.655317:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a0c348d7800, transno 4294967310 00000100:00100000:1.0:1788846004.655342:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739053056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846004.655602:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739053312 00000100:00100000:0.0:1788846004.655608:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739053312 00000100:00100000:0.0:1788846004.655650:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788846004.655659:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740739053312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846004.655714:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740739053312:12345-0@lo:400:kworker.0 Request processed in 57us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846004.655721:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788846004.655805:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740739053312:0@lo:400:kworker.0 00000100:00100000:3.0:1788846004.655832:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846004.655910:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739053696:0@lo:400:kworker.0 00000100:00100000:3.0:1788846004.655943:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846004.656047:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739053696 00000100:00100000:2.0:1788846004.656051:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739053696 00000100:00100000:2.0:1788846004.656094:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788846004.656100:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739053696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846004.656135:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739053696:12345-0@lo:400:kworker.0 Request processed in 35us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846004.656141:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788846004.656209:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788846004.656231:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739053696:0@lo:400:kworker.0 00000100:00100000:1.0:1788846004.656361:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739053184 00000100:00100000:1.0:1788846004.656366:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739053184 00000100:00100000:1.0:1788846004.656489:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788846004.656498:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739053184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846004.656544:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739053184:12345-0@lo:400:kworker.0 Request processed in 48us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846004.656551:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788846004.656610:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739053184:0@lo:400:kworker.0 00010000:00010000:2.0:1788846004.902425:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846005.151322:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846005.151405:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846005.151436:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846005.151456:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846005.151518:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846005.151553:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720203904 00000100:00100000:1.0:1788846005.151562:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720203904 00000100:00100000:1.0:1788846005.151607:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720203520 00000100:00100000:1.0:1788846005.151610:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720203520 00000100:00100000:1.0:1788846005.151631:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 139 00000100:00100000:1.0:1788846005.151640:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+6:2351:x1875740720203904:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788846005.151727:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+6:2351:x1875740720203904:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 87us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846005.151735:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 139 00000100:00100000:1.0:1788846005.151752:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00100000:1.0:1788846005.151758:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+19:2351:x1875740720203520:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788846005.151787:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+19:2351:x1875740720203520:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 29us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846005.151793:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00080000:1.0:1788846005.151808:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846005.151828:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720203648 00000100:00100000:1.0:1788846005.151830:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720203648 00000100:00100000:1.0:1788846005.151875:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720203776 00000100:00100000:1.0:1788846005.151879:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720203776 00000100:00100000:1.0:1788846005.151901:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:1.0:1788846005.151907:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+7:2351:x1875740720203648:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788846005.151931:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d675880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+7:2351:x1875740720203648:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846005.151937:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:1.0:1788846005.151949:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:1.0:1788846005.151954:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d674000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2351:x1875740720203776:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788846005.151973:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d674000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4592a189-21d8-449a-9335-07bfe0dc7877+5:2351:x1875740720203776:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 20us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846005.151979:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00080000:1.0:1788846005.151997:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788846005.152000:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788846005.153148:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720203392 00000100:00100000:0.0:1788846005.153167:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720203392 00000100:00100000:0.0:1788846005.153210:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 290 00000100:00100000:0.0:1788846005.153218:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2354:x1875740720203392:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788846005.153561:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+13:2354:x1875740720203392:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 343us (2247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846005.153569:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 290 00000001:02000400:1.0:1788846005.640314:0:12813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:40:04 (1788846004) 00010000:00010000:1.0:1788846005.926366:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846006.958250:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846007.718789:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739053824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788846007.718868:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846007.719280:0:8920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739053824 00000100:00100000:0.0:1788846007.719288:0:8920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739053824 00000100:00100000:0.0:1788846007.719515:0:8920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788846007.719528:0:8920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739053824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788846007.719565:0:8920:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788846007.719634:0:8920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739053824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846007.719641:0:8920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788846007.719724:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739053824:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788846007.721512:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788846007.846362:0:11678:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788846007.846371:0:11678:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788846007.846643:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788846007.846650:0:11678:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788846007.974542:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846008.338896:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846008.338991:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720204160 00000100:00100000:0.0:1788846008.339000:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720204160 00000100:00100000:0.0:1788846008.339069:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:0.0:1788846008.339083:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+19:12314:x1875740720204160:12345-192.168.206.48@tcp:35:umount.0 00000100:00100000:0.0:1788846008.339460:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+20:12314:x1875740720204160:12345-192.168.206.48@tcp:35:umount.0 Request processed in 381us (571us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788846008.339468:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00080000:1.0:1788846008.340122:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846008.342809:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846008.342891:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720204416 00000100:00100000:3.0:1788846008.342954:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720204416 00000100:00100000:3.0:1788846008.343010:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:3.0:1788846008.343021:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+20:12314:x1875740720204416:12345-192.168.206.48@tcp:35:umount.0 00000100:00100000:3.0:1788846008.343389:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+21:12314:x1875740720204416:12345-192.168.206.48@tcp:35:umount.0 Request processed in 369us (586us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788846008.343406:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:2.0:1788846008.346630:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846008.346728:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720204672 00000100:00100000:0.0:1788846008.346738:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720204672 00000100:00100000:0.0:1788846008.346904:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:0.0:1788846008.346916:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c08dc2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+21:12314:x1875740720204672:12345-192.168.206.48@tcp:35:umount.0 00000100:00100000:0.0:1788846008.347134:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c08dc2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4592a189-21d8-449a-9335-07bfe0dc7877+22:12314:x1875740720204672:12345-192.168.206.48@tcp:35:umount.0 Request processed in 220us (511us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788846008.347141:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:2.0:1788846008.351646:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846008.351732:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720204928 00000100:00100000:3.0:1788846008.351741:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720204928 00000100:00100000:3.0:1788846008.351927:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:3.0:1788846008.351938:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+22:12314:x1875740720204928:12345-192.168.206.48@tcp:35:umount.0 00000100:00100000:3.0:1788846008.352648:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4592a189-21d8-449a-9335-07bfe0dc7877+23:12314:x1875740720204928:12345-192.168.206.48@tcp:35:umount.0 Request processed in 709us (1008us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788846008.352657:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:2.0:1788846008.360935:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846008.361042:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846008.361071:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846008.361300:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846008.361345:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720205440 00000100:00100000:1.0:1788846008.361354:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720205440 00000100:00100000:1.0:1788846008.361418:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:1.0:1788846008.361428:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+5:2350:x1875740720205440:12345-192.168.206.48@tcp:9:umount.0 00000020:00000080:1.0:1788846008.361458:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773f240 00000100:00080000:1.0:1788846008.361466:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9a0c074bd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788846008.361497:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788846008.361741:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4592a189-21d8-449a-9335-07bfe0dc7877+2:2350:x1875740720205440:12345-192.168.206.48@tcp:9:umount.0 Request processed in 313us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846008.361750:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 73 00010000:00010000:1.0:1788846008.361788:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788846008.361796:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788846008.366661:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720205056 00000100:00100000:3.0:1788846008.366682:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720205056 00000100:00100000:0.0:1788846008.366691:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720205184 00000100:00100000:0.0:1788846008.366708:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720205184 00000100:00100000:3.0:1788846008.366780:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720205312 00000100:00100000:3.0:1788846008.366784:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720205312 00000100:00100000:0.0:1788846008.366844:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:0.0:1788846008.366870:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a77a96b-0efb-4559-b734-596c51917804+15:2353:x1875740720205056:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846008.366886:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846008.366906:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c3ebcf200/0x1345bc80c773ef68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc2b expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846008.366921:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846008.366980:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a77a96b-0efb-4559-b734-596c51917804+14:2353:x1875740720205056:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 115us (5938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846008.366988:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:0.0:1788846008.367006:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:0.0:1788846008.367013:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a77a96b-0efb-4559-b734-596c51917804+13:2354:x1875740720205184:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846008.367020:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846008.367029:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c12f56800/0x1345bc80c773eece lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cbf3 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846008.367039:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846008.367070:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9a77a96b-0efb-4559-b734-596c51917804+12:2354:x1875740720205184:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 58us (5999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846008.367077:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:3.0:1788846008.367312:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:3.0:1788846008.367352:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a77a96b-0efb-4559-b734-596c51917804+11:2353:x1875740720205312:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846008.367361:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846008.367371:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c12f56200/0x1345bc80c773f152 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccf6 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846008.367383:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846008.367416:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a77a96b-0efb-4559-b734-596c51917804+10:2353:x1875740720205312:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 67us (6116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846008.367423:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:1.0:1788846008.371542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846008.371704:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720205824 00000100:00100000:2.0:1788846008.371714:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720205824 00000100:00100000:2.0:1788846008.371784:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:2.0:1788846008.371795:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d674700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+7:2350:x1875740720205824:12345-192.168.206.48@tcp:9:umount.0 00000020:00000080:2.0:1788846008.371839:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773f4a1 00000020:00010000:2.0:1788846008.371857:0:6689:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a0c3d38f800: total 0 00000100:00080000:2.0:1788846008.371861:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d38c800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788846008.372030:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1788846008.372087:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788846008.372401:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d674700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4592a189-21d8-449a-9335-07bfe0dc7877+5:2350:x1875740720205824:12345-192.168.206.48@tcp:9:umount.0 Request processed in 598us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846008.372410:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 74 00000020:00010000:3.0:1788846008.373992:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a0c3d38f800: total 0 00010000:00010000:0.0:1788846008.374675:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a0c3d38f800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788846008.374733:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c773f844 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cecb expref: 4 pid: 11681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846008.374769:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062e9b86f/0x1345bc80c773fee2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d099 expref: 3 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846008.375413:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a0c3d38f800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788846008.375432:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846008.375434:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846008.375436:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846008.382430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846008.382601:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720206848 00000100:00100000:1.0:1788846008.382611:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720206848 00000100:00100000:1.0:1788846008.382668:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 240 00000100:00100000:1.0:1788846008.382678:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+23:2350:x1875740720206848:12345-192.168.206.48@tcp:39:umount.0 00000020:00000080:1.0:1788846008.382709:0:5845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773eedc 00000020:00010000:1.0:1788846008.382728:0:5845:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a0b0503b800: total 0 00000100:00080000:1.0:1788846008.382733:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9a0b0503e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788846008.382760:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1788846008.383124:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4592a189-21d8-449a-9335-07bfe0dc7877+22:2350:x1875740720206848:12345-192.168.206.48@tcp:39:umount.0 Request processed in 446us (701us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788846008.383145:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 240 00000020:00010000:2.0:1788846008.383939:0:6704:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a0b0503b800: total 0 00010000:00010000:2.0:1788846008.383984:0:6704:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a0b0503b800, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1788846008.384015:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:2.0:1788846008.384019:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846008.384027:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031000/0x1345bc80c773f805 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceb6 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384047:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:2.0:1788846008.384049:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788846008.384052:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c01475a00/0x1345bc80c773fe95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d084 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384063:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382100) 00010000:00010000:2.0:1788846008.384065:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846008.384068:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01e00/0x1345bc80c773f8a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cee7 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384078:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f200) 00010000:00010000:2.0:1788846008.384080:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846008.384084:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031200/0x1345bc80c773f1c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd0b expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384113:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a0c04c4fd00) 00010000:00010000:2.0:1788846008.384115:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846008.384119:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030400/0x1345bc80c773f1a6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd04 expref: 17 pid: 7134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384144:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:2.0:1788846008.384147:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788846008.384189:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcee00/0x1345bc80c773f82f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cec4 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384204:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:2.0:1788846008.384206:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788846008.384210:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c773fecd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d092 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384231:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:2.0:1788846008.384233:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788846008.384237:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a00c00/0x1345bc80c773fdc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d04c expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384250:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:2.0:1788846008.384252:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788846008.384256:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c02824000/0x1345bc80c773f503 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cdf2 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384265:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:2.0:1788846008.384267:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788846008.384278:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3ebcfe00/0x1345bc80c773f8c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ceee expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384290:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a0c11677300) 00010000:00010000:2.0:1788846008.384301:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788846008.384304:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00030e00/0x1345bc80c773fba1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cfc0 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384318:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a0c31164d00) 00010000:00010000:2.0:1788846008.384320:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788846008.384323:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c00031600/0x1345bc80c773f725 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ce7e expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384334:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a0c31164000) 00010000:00010000:2.0:1788846008.384336:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788846008.384339:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c12f56600/0x1345bc80c773f216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cd20 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384351:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a0c10382d00) 00010000:00010000:2.0:1788846008.384353:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846008.384357:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c8a00/0x1345bc80c773febf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d08b expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846008.384370:0:6704:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a0b0503b800, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1788846008.384382:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846008.384384:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846008.384386:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788846008.788961:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:1.0:1788846008.788981:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4592a189-21d8-449a-9335-07bfe0dc7877 00000001:00080000:1.0:1788846008.788988:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00080000:1.0:1788846008.788997:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00000080:1.0:1788846008.789018:0:5867:0:(genops.c:885:class_export_put()) final put ffff9a0b0503b800/4592a189-21d8-449a-9335-07bfe0dc7877 00000020:00000080:0.0:1788846008.789095:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0b0503b800/4592a189-21d8-449a-9335-07bfe0dc7877 for lustre-MDT0000 00000020:00000080:0.0:1788846008.789181:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0b0503e800 for lustre-MDT0000 00000020:00080000:2.0:1788846008.789329:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788846008.789341:0:5878:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00100000:0.0:1788846008.792943:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4592a189-21d8-449a-9335-07bfe0dc7877 00000020:00000080:0.0:1788846008.792952:0:6720:0:(genops.c:885:class_export_put()) final put ffff9a0c3d38f800/4592a189-21d8-449a-9335-07bfe0dc7877 00000020:00000080:1.0:1788846008.793022:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3d38f800/4592a189-21d8-449a-9335-07bfe0dc7877 for lustre-OST0000 00000020:00000080:1.0:1788846008.793082:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c3d38c800 for lustre-OST0000 00010000:00010000:2.0:1788846009.000212:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846009.766422:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739053952:0@lo:400:kworker.0 00000100:00100000:0.0:1788846009.766422:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739054208:0@lo:400:kworker.0 00000100:00100000:2.0:1788846009.766558:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739054336:0@lo:400:kworker.0 00000100:00100000:1.0:1788846009.766797:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739054080:0@lo:400:kworker.0 00000100:00100000:0.0:1788846009.769044:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846009.770286:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d67df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739054720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846009.770344:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846009.770397:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739054720 00000100:00100000:0.0:1788846009.770405:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739054720 00000100:00100000:0.0:1788846009.771695:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788846009.771717:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739054720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788846009.771769:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788846009.771838:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739054720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846009.771855:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788846009.771883:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788846009.771922:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d67df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739054720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846009.771965:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739054208 00000100:00100000:0.0:1788846009.771971:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739054208 00000100:00100000:0.0:1788846009.772008:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788846009.772017:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739054208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846009.772054:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739054208:12345-0@lo:400:kworker.0 Request processed in 39us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846009.772060:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1788846009.772077:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788846009.772186:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739054208:0@lo:400:kworker.0 00000100:00100000:3.0:1788846009.772592:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846009.772642:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739054464:0@lo:400:kworker.0 00000100:00100000:3.0:1788846009.772682:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846009.772717:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739054464 00000100:00100000:3.0:1788846009.772722:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739054464 00000100:00100000:3.0:1788846009.772982:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788846009.772989:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739054464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846009.773029:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875740739054464:12345-0@lo:400:kworker.0 Request processed in 41us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846009.773035:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1788846009.773053:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788846009.773073:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875740739054464:0@lo:400:kworker.0 00000100:00100000:0.0:1788846009.773416:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739053952 00000100:00100000:0.0:1788846009.773421:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739053952 00000100:00100000:0.0:1788846009.773458:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788846009.773465:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739053952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846009.773504:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3309:x1875740739053952:12345-0@lo:400:kworker.0 Request processed in 40us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846009.773511:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788846009.773600:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739053952:0@lo:400:kworker.0 00000100:00100000:2.0:1788846009.776733:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846009.777888:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739054336 00000100:00100000:3.0:1788846009.777902:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739054336 00000100:00100000:3.0:1788846009.777983:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788846009.777993:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739054336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846009.778071:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739054336:12345-0@lo:400:kworker.0 Request processed in 79us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846009.778079:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788846009.778471:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739054336:0@lo:400:kworker.0 00000100:00100000:0.0:1788846009.778595:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846009.778664:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739054592:0@lo:400:kworker.0 00000100:00080000:2.0:1788846009.778669:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788846009.778696:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846009.783510:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739054080 00000100:00100000:1.0:1788846009.783525:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739054080 00000100:00100000:1.0:1788846009.783581:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788846009.783591:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739054080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846009.783675:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875740739054080:12345-0@lo:400:kworker.0 Request processed in 86us (5080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846009.783684:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788846009.784790:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846009.784826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846009.784876:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846009.784926:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875740739054080:0@lo:400:kworker.0 00000100:00100000:3.0:1788846009.785012:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720206976 00000100:00100000:3.0:1788846009.785019:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720206976 00000100:00100000:3.0:1788846009.785069:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720207232 00000100:00100000:3.0:1788846009.785072:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720207232 00000100:00100000:3.0:1788846009.785086:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720207104 00000100:00100000:3.0:1788846009.785088:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720207104 00000100:00100000:3.0:1788846009.785103:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:3.0:1788846009.785126:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d673800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a77a96b-0efb-4559-b734-596c51917804+12:2354:x1875740720206976:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846009.785137:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846009.785180:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01475600/0x1345bc80c773efae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc40 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846009.785195:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846009.785239:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d673800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a77a96b-0efb-4559-b734-596c51917804+11:2354:x1875740720206976:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 115us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846009.785246:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:3.0:1788846009.785261:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:3.0:1788846009.785269:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d672d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a77a96b-0efb-4559-b734-596c51917804+10:2354:x1875740720207232:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846009.785276:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846009.785285:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02825400/0x1345bc80c773f14b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305ccef expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846009.785294:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846009.785311:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d672d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a77a96b-0efb-4559-b734-596c51917804+9:2354:x1875740720207232:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 43us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846009.785317:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:3.0:1788846009.785329:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:3.0:1788846009.785334:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c02d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a77a96b-0efb-4559-b734-596c51917804+8:2354:x1875740720207104:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846009.785341:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846009.785349:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01475000/0x1345bc80c773efb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc6a expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846009.785357:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846009.785382:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c02d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a77a96b-0efb-4559-b734-596c51917804+7:2354:x1875740720207104:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 48us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846009.785388:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:2.0:1788846009.789549:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739054592 00000100:00100000:2.0:1788846009.789563:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739054592 00000100:00100000:2.0:1788846009.789625:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788846009.789635:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739054592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846009.789727:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739054592:12345-0@lo:400:kworker.0 Request processed in 93us (11030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846009.789734:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788846009.791068:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739054592:0@lo:400:kworker.0 00000100:00100000:3.0:1788846009.792492:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846009.792560:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720207488 00000100:00100000:1.0:1788846009.792569:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720207488 00000100:00100000:1.0:1788846009.792637:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 241 00000100:00100000:1.0:1788846009.792646:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+6:2350:x1875740720207488:12345-192.168.206.48@tcp:39:umount.0 00000020:00000080:1.0:1788846009.792681:0:5845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773efc3 00000020:00010000:1.0:1788846009.792688:0:5845:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a0c34df0000: total 0 00000100:00080000:1.0:1788846009.792693:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9a0c34df7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788846009.792734:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1788846009.793110:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8450d7e-d658-40b4-8296-b4731edf9929+5:2350:x1875740720207488:12345-192.168.206.48@tcp:39:umount.0 Request processed in 464us (622us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788846009.793118:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 241 00000020:00010000:0.0:1788846009.793960:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a0c34df0000: total 0 00010000:00010000:0.0:1788846009.793966:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846009.794008:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a0c34df0000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788846009.794040:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c10382100) 00010000:00010000:0.0:1788846009.794044:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788846009.794053:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c013c9c00/0x1345bc80c773fef0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0a0 expref: 4 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846009.794077:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a0c34df0000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788846009.794088:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846009.794090:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846009.794092:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788846009.795949:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788846009.816009:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846009.816104:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720207744 00000100:00100000:0.0:1788846009.816113:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720207744 00000100:00100000:0.0:1788846009.816189:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 292 00000100:00100000:0.0:1788846009.816199:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+7:2350:x1875740720207744:12345-192.168.206.48@tcp:251:umount.0 00000020:00000080:0.0:1788846009.816236:0:5840:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773eeb9 00000020:00010000:0.0:1788846009.816243:0:5840:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a0b0503d800: total 0 00000100:00080000:0.0:1788846009.816248:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9a0b05039000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788846009.816304:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a77a96b-0efb-4559-b734-596c51917804+3:2350:x1875740720207744:12345-192.168.206.48@tcp:251:umount.0 Request processed in 107us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846009.816311:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 292 00000020:00010000:2.0:1788846009.816705:0:6704:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a0b0503d800: total 0 00010000:00010000:2.0:1788846009.816749:0:6704:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a0b0503d800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788846009.816782:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c3ebcf000/0x1345bc80c773ef6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305cc32 expref: 2 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846009.816797:0:6704:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a0b0503d800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788846009.816808:0:6704:0:(genops.c:885:class_export_put()) final put ffff9a0b0503d800/9a77a96b-0efb-4559-b734-596c51917804 00010000:00010000:2.0:1788846009.816824:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846009.816826:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846009.816827:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788846009.820016:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0b0503d800/9a77a96b-0efb-4559-b734-596c51917804 for MGS 00000020:00000080:0.0:1788846009.820060:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0b05039000 for MGS 00010000:00010000:2.0:1788846010.022410:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846011.047304:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788846011.088293:0:13011:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788846011.098667:0:13011:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788846011.098710:0:13011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.098724:0:13011:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.098730:0:13011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.098736:0:13011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.098760:0:13011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788846011.098765:0:13011:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788846011.098785:0:13011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788846011.098788:0:13011:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788846011.098794:0:13011:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788846011.098815:0:13011:0:(import.c:65:import_set_state_nolock()) ffff9a0c3da33000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788846011.098884:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875740739054848:0@lo:39:umount.0 00000100:00100000:1.0:1788846011.098943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846011.099012:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739054848 00000100:00100000:3.0:1788846011.099020:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739054848 00010000:00010000:2.0:1788846011.099049:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846011.099056:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.099065:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824a00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788846011.099069:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846011.099085:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788846011.099094:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875740739054848:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788846011.099116:0:7134:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ecc8 00000100:00080000:3.0:1788846011.099123:0:7134:0:(import.c:65:import_set_state_nolock()) ffff9a0c3eb10000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788846011.099182:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846011.099190:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846011.099197:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788846011.099461:0:6704:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788846011.099465:0:6704:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788846011.099490:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.099496:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846011.099614:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.099622:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c02824a00/0x1345bc80c773ef3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ef45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.099633:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846011.099635:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846011.099636:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846011.099641:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846011.099646:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846011.099657:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739054976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846011.099686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846011.099718:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739054976 00000100:00100000:2.0:1788846011.099722:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739054976 00000100:00100000:2.0:1788846011.099753:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788846011.099759:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d67dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3307:x1875740739054976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846011.099776:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846011.099789:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02824600/0x1345bc80c773ef45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773ef3e expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.099800:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846011.099829:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d67dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:3307:x1875740739054976:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846011.099846:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788846011.099885:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739054976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846011.099947:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3306:x1875740739054848:12345-0@lo:39:umount.0 Request processed in 851us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846011.099955:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788846011.099965:0:7134:0:(genops.c:885:class_export_put()) final put ffff9a0c3eb15800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1788846011.099966:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c3da33000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788846011.099978:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875740739054848:0@lo:39:umount.0 00000020:00000080:3.0:1788846011.099992:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3eb15800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1788846011.100062:0:13011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788846011.100066:0:13011:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788846011.100070:0:13011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788846011.100083:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c3eb10000 for lustre-MDT0000 00010000:00010000:0.0:1788846011.101283:0:13011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101297:0:13011:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101305:0:13011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101322:0:13011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101343:0:13011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846011.101349:0:13011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101356:0:13011:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101362:0:13011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101368:0:13011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101383:0:13011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788846011.101388:0:13011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101395:0:13011:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101401:0:13011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101407:0:13011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101427:0:13011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788846011.101433:0:13011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57e00/0x1345bc80c773ec27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101439:0:13011:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57e00/0x1345bc80c773ec27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101445:0:13011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57e00/0x1345bc80c773ec27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101452:0:13011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57e00/0x1345bc80c773ec27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846011.101459:0:13011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788846011.101462:0:13011:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788846011.101485:0:13011:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788846011.101489:0:13011:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788846011.101493:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846011.101498:0:13011:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1788846011.101514:0:13011:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a0c3d13c800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788846011.101520:0:13011:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a0c3536a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788846011.101527:0:13011:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a0c34df0000 d8450d7e-d658-40b4-8296-b4731edf9929 192.168.206.48@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788846011.101531:0:13011:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9a0c088c19b8) has exports, disconnecting them 00000020:00080000:0.0:1788846011.101535:0:13011:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a0c3d13c800), last request at 1788846009 00000020:00000080:0.0:1788846011.101541:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ee3b 00000100:00080000:0.0:1788846011.101558:0:13011:0:(import.c:65:import_set_state_nolock()) ffff9a0b0503f800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788846011.101600:0:13011:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a0c3d13c800): rc 0 00000020:00000080:0.0:1788846011.101608:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3d13c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788846011.101616:0:13011:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a0c3536a800), last request at 1788846009 00000020:00000080:0.0:1788846011.101620:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ed8c 00000100:00080000:0.0:1788846011.101628:0:13011:0:(import.c:65:import_set_state_nolock()) ffff9a0c3536a000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788846011.101635:0:13011:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a0c3536a800): rc 0 00000020:00000080:0.0:1788846011.101637:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3536a800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788846011.101643:0:13011:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb360c1b67ae0 00000100:00080000:0.0:1788846011.101658:0:13011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788846011.101661:0:13011:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788846011.101673:0:13011:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788846011.101734:0:13011:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788846011.101751:0:13011:0:(import.c:65:import_set_state_nolock()) ffff9a0b04977800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788846011.101766:0:13011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788846011.101768:0:13011:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788846011.101775:0:13011:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788846011.101827:0:13011:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788846011.101846:0:13011:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d13f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788846011.101870:0:13011:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a0c088c19b8) has no exports 00010000:00010000:2.0:1788846011.101935:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788846011.101942:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.101950:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825600 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788846011.101954:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.101962:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846011.101969:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846011.101975:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788846011.101977:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788846011.101979:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788846011.102000:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.102017:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846011.102043:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.102051:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c02825600/0x1345bc80c773ef4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ef53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.102064:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00000080:3.0:1788846011.102066:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3d13c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1788846011.102068:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.102077:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475200 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788846011.102080:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.102086:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846011.102093:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846011.102099:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788846011.102101:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788846011.102104:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00000080:3.0:1788846011.102116:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3536a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1788846011.102120:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.102127:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846011.102134:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788846011.102141:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0b0503f800 for lustre-MDT0000 00000020:00000080:3.0:1788846011.102148:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c3536a000 for lustre-MDT0000 00010000:00010000:3.0:1788846011.102175:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788846011.102176:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c01475200/0x1345bc80c773ee73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ee7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846011.102183:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846011.102194:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824400 already unused, calling callback (ffffffffc1ba4c20) 00010000:00010000:2.0:1788846011.102194:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:3.0:1788846011.102198:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.102200:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57e00/0x1345bc80c773ec27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.102217:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57e00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:2.0:1788846011.102222:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57e00/0x1345bc80c773ec27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846011.102235:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.102237:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57e00/0x1345bc80c773ec27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846011.102253:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846011.102255:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57e00/0x1345bc80c773ec27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846011.102271:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788846011.102273:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788846011.102276:0:6704:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788846011.102278:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788846011.102281:0:6704:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788846011.102282:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788846011.102304:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846011.102311:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846011.102319:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57e00/0x1345bc80c773ec27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.102327:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846011.102330:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.102337:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57e00/0x1345bc80c773ec27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846011.102346:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c02824400/0x1345bc80c773f175 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773f17c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.102346:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57e00/0x1345bc80c773ec27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ec2e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846011.102371:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846011.102374:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846011.102387:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846011.102390:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846011.102391:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846011.102394:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846011.102407:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739055744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846011.102475:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d67df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739055488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846011.102478:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788846011.102511:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846011.102519:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739055616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846011.102708:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846011.102726:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788846011.102734:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739055360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846011.102756:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846011.102901:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739055104:0@lo:9:umount.0 00000100:00100000:1.0:1788846011.102934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846011.102954:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739055232:0@lo:9:umount.0 00000100:00100000:1.0:1788846011.102974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846011.103005:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739055104 00000100:00100000:1.0:1788846011.103010:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739055104 00000100:00100000:1.0:1788846011.103049:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739055232 00000100:00100000:1.0:1788846011.103052:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739055232 00000100:00100000:1.0:1788846011.103073:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788846011.103080:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875740739055104:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788846011.103099:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773edbd 00000100:00080000:1.0:1788846011.103105:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d8b5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788846011.103127:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788846011.103415:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3306:x1875740739055104:12345-0@lo:9:umount.0 Request processed in 335us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846011.103422:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788846011.103437:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788846011.103443:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d675500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875740739055232:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788846011.103462:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773eeb2 00000100:00080000:1.0:1788846011.103468:0:6689:0:(import.c:65:import_set_state_nolock()) ffff9a0c34df2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788846011.103488:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788846011.103588:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d675500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3306:x1875740739055232:12345-0@lo:9:umount.0 Request processed in 145us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846011.103594:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788846011.103612:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788846011.103615:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788846011.103624:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788846011.103646:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0b04977800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788846011.103656:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788846011.103658:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788846011.103661:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739055104:0@lo:9:umount.0 00000100:00080000:1.0:1788846011.103670:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d13f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788846011.103676:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788846011.103677:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788846011.103679:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739055232:0@lo:9:umount.0 00010000:00010000:1.0:1788846011.103703:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846011.105496:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739055744 00000100:00100000:2.0:1788846011.105572:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739055744 00000100:00100000:2.0:1788846011.105638:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739055488 00000100:00100000:2.0:1788846011.105641:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739055488 00000100:00100000:2.0:1788846011.105659:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739055360 00000100:00100000:2.0:1788846011.105662:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739055360 00000100:00100000:2.0:1788846011.105680:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788846011.105688:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355d8611-f7e8-4bd6-8079-f3ef5a03a561+20:3308:x1875740739055744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846011.105702:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846011.105720:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c00030800/0x1345bc80c773ec2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773ec27 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.105738:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846011.105802:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355d8611-f7e8-4bd6-8079-f3ef5a03a561+19:3308:x1875740739055744:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (3326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846011.105809:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788846011.105825:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788846011.105831:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355d8611-f7e8-4bd6-8079-f3ef5a03a561+18:3310:x1875740739055488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846011.105849:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846011.105857:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02825a00/0x1345bc80c773ee7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773ee73 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.105880:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846011.105911:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355d8611-f7e8-4bd6-8079-f3ef5a03a561+17:3310:x1875740739055488:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (3203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846011.105917:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788846011.105930:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788846011.105936:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355d8611-f7e8-4bd6-8079-f3ef5a03a561+16:3310:x1875740739055360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846011.105942:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846011.105951:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02825c00/0x1345bc80c773ef53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773ef4c expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846011.105958:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846011.105978:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:3310:x1875740739055360:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (3221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846011.105984:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788846011.106377:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739055744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846011.106411:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846011.106538:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739055360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846011.106553:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d67df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739055488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846011.106572:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739055616 00000100:00100000:3.0:1788846011.106585:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739055616 00000100:00100000:3.0:1788846011.107278:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788846011.107290:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b05929500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+15:3307:x1875740739055616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846011.107303:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846011.107321:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02825e00/0x1345bc80c773f17c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773f175 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846011.107337:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846011.107402:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b05929500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:3307:x1875740739055616:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846011.107613:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788846011.107939:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3307:1875740739055616:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788846011.124030:0:13011:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a0c088c19b8) has no exports 00000020:00000080:2.0:1788846011.181261:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ec82 00000020:00000080:2.0:1788846011.181275:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3da30800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788846011.181296:0:13011:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788846011.181327:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3da30800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788846011.182232:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846011.182243:0:13011:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788846011.182248:0:13011:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9a0c3eadcd28) has no exports 00000020:00000080:0.0:1788846011.182628:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ec7b 00000020:00000080:0.0:1788846011.182756:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3ead7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788846011.182827:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846011.182845:0:13011:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788846011.182848:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3ead7800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788846011.182852:0:13011:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3ead7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788846011.182859:0:13011:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788846011.183266:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3ead7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788846012.070445:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846013.094558:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788846013.425740:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788846013.425748:0:7645:0:(genops.c:885:class_export_put()) final put ffff9a0c34df1000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788846013.425771:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4592a189-21d8-449a-9335-07bfe0dc7877 00000020:00000080:0.0:1788846013.425774:0:7645:0:(genops.c:885:class_export_put()) final put ffff9a0c074ba800/4592a189-21d8-449a-9335-07bfe0dc7877 00000020:00000080:1.0:1788846013.425830:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c34df1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788846013.425885:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c074ba800/4592a189-21d8-449a-9335-07bfe0dc7877 for lustre-OST0001 00000020:00000080:1.0:1788846013.425902:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c34df2000 for lustre-OST0001 00000020:00000080:1.0:1788846013.425907:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c074bd000 for lustre-OST0001 00000001:00100000:1.0:1788846013.892513:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d8450d7e-d658-40b4-8296-b4731edf9929 00000001:00080000:1.0:1788846013.892530:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788846013.892536:0:5867:0:(genops.c:885:class_export_put()) final put ffff9a0c34df0000/d8450d7e-d658-40b4-8296-b4731edf9929 00000020:00000080:0.0:1788846013.892893:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c34df0000/d8450d7e-d658-40b4-8296-b4731edf9929 for lustre-MDT0000 00000020:00000080:0.0:1788846013.892967:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c34df7000 for lustre-MDT0000 00000001:00100000:0.0:1788846013.909977:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788846013.909986:0:6720:0:(genops.c:885:class_export_put()) final put ffff9a0c3d8b2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788846013.910071:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3d8b2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788846013.910225:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c3d8b5800 for lustre-OST0000 00010000:00010000:1.0:1788846014.118841:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846014.886414:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739056128:0@lo:400:kworker.0 00000100:00100000:0.0:1788846014.886475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846014.886563:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739056128 00000100:00100000:0.0:1788846014.886570:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739056128 00000100:00100000:0.0:1788846014.886615:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788846014.886622:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875740739056128:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788846014.886629:0:5845:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788846014.886666:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875740739056128:12345-0@lo:400:kworker.0 Request processed in 42us (190us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788846014.886672:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1788846014.886709:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788846014.886714:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a0b04969000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788846014.886717:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788846014.887953:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739055872:0@lo:400:kworker.0 00000100:00100000:3.0:1788846014.888008:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846014.888049:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788846014.888055:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739056000:0@lo:400:kworker.0 00000100:00100000:3.0:1788846014.888081:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846014.888127:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739055872 00000100:00100000:3.0:1788846014.888134:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739055872 00000100:00100000:3.0:1788846014.888199:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788846014.888208:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c184c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:3309:x1875740739055872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846014.888253:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c184c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:355d8611-f7e8-4bd6-8079-f3ef5a03a561+14:3309:x1875740739055872:12345-0@lo:400:kworker.0 Request processed in 45us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846014.888260:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788846014.888288:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739056000 00000100:00100000:3.0:1788846014.888291:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739056000 00000100:00100000:3.0:1788846014.888310:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788846014.888314:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875740739056000:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788846014.888335:0:5847:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788846014.888357:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875740739056000:12345-0@lo:400:kworker.0 Request processed in 42us (276us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788846014.888362:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1788846014.888388:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788846014.888393:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d8b5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788846014.888396:0:3309:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788846014.888400:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d8b5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846014.888403:0:3309:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 170 00000100:00080000:3.0:1788846014.888408:0:3309:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a0c3d8b5000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1788846014.888429:0:3309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3d529f80 x1875740739056256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788846014.888451:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739056000:0@lo:400:kworker.0 00000100:00100000:3.0:1788846014.888462:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739055872:0@lo:400:kworker.0 00000100:00100000:3.0:1788846014.888504:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875740739056256:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788846014.888525:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846014.888550:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739056256 00000100:00100000:3.0:1788846014.888554:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739056256 00000100:00100000:3.0:1788846014.888574:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788846014.888578:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875740739056256:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788846014.888591:0:5845:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1788846014.900034:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a0b04969000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846014.900045:0:3307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 190 00000100:00080000:0.0:1788846014.900054:0:3307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a0b04969000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1788846014.900189:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3d673800 x1875740739056384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788846014.900236:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739056128:0@lo:400:kworker.0 00000100:00100000:2.0:1788846014.900380:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875740739056384:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788846014.900442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846014.900598:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739056384 00000100:00100000:0.0:1788846014.900605:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739056384 00000100:00100000:0.0:1788846014.900642:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788846014.900648:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b05929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875740739056384:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788846014.900662:0:5847:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788846014.900707:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b05929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875740739056384:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 57us (265us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788846014.900714:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1788846014.901202:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0b04969000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788846014.901208:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788846014.901211:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875740739056384:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788846014.917951:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875740739056256:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 29364us (29417us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788846014.917966:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1788846014.918003:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d8b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846014.918010:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788846014.918014:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875740739056256:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1788846015.143786:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846016.167086:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846017.190594:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788846017.254247:0:13011:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a0c3cff1000 - data ffff9a0c2ab36360/ffff9a0c2632f000 00000020:01000000:0.0:1788846017.254375:0:13011:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a0c07519240 - data ffff9a0c1e806510/ffff9a0c3eb1c000 00000001:00000004:0.0:1788846017.259859:0:13011:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788846017.331555:0:13011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788846017.331563:0:13011:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788846017.331648:0:13011:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846017.331652:0:13011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788846017.332277:0:6716:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788846017.332282:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788846017.332292:0:6716:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788846017.333308:0:13011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788846017.333312:0:13011:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788846017.333325:0:13011:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846017.333327:0:13011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788846017.333673:0:8092:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788846017.333677:0:8092:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788846017.333689:0:8092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788846017.421795:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ec4a 00000020:00000080:3.0:1788846017.421819:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3c96a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788846017.422391:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3c96a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788846017.422955:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ec5f 00000020:00000080:3.0:1788846017.422964:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3da31000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788846017.423013:0:13011:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788846017.423021:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846017.423029:0:13011:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788846017.423034:0:13011:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9a0c088c3370) has no exports 00000004:01000000:3.0:1788846017.423304:0:13011:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788846017.423313:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ee9d 00000020:00000080:3.0:1788846017.423363:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c34df4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788846017.423667:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3da31000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788846017.423730:0:13011:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788846017.423735:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846017.423742:0:13011:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788846017.423746:0:13011:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9a0c35178000) has no exports 00000020:00000080:3.0:1788846017.423752:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ee96 00000020:00000080:3.0:1788846017.423757:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3d13a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788846017.423778:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c34df4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788846017.426587:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3d13a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788846017.429825:0:13011:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788846017.429833:0:13011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788846017.429837:0:13011:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788846017.429845:0:13011:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846017.429848:0:13011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788846017.429947:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846017.429959:0:13011:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788846017.429967:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ed93 00000020:00000080:2.0:1788846017.429976:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3d8b2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788846017.429999:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c3d13f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788846017.430005:0:8:0:(genops.c:885:class_export_put()) final put ffff9a0c34df5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788846017.430008:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c34df5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788846017.430016:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788846017.430250:0:13011:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788846017.430255:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846017.430261:0:13011:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788846017.430265:0:13011:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9a0c089a3370) has no exports 00000020:00000080:2.0:1788846017.430271:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ed77 00000020:00000080:2.0:1788846017.430275:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0b04971800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788846017.430292:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3d8b2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1788846017.430708:0:13011:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788846017.430711:0:13011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788846017.430714:0:13011:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788846017.430718:0:13011:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846017.430738:0:13011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788846017.433873:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0b04971800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788846017.434221:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846017.434236:0:13011:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788846017.434271:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846017.434276:0:13011:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788846017.434281:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3c96e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788846017.434285:0:13011:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3c96e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788846017.434297:0:13011:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788846017.435187:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ec66 00000020:00000080:2.0:1788846017.435196:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3da35800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788846017.435523:0:13011:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788846017.435530:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846017.435537:0:13011:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788846017.435541:0:13011:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9a0c088c0000) has no exports 00000020:00000080:2.0:1788846017.435568:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846017.435618:0:13011:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788846017.435623:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ec6d 00000020:00000080:2.0:1788846017.435628:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3da37000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788846017.435648:0:13011:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a0c0942a000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788846017.435651:0:13011:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a0c0942a000 3 00000020:01000004:2.0:1788846017.435655:0:13011:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a0c0942a000 from lustre-MDT0000 00000020:00000080:2.0:1788846017.435675:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846017.435678:0:13011:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788846017.435694:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3c96b000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788846017.435697:0:13011:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3c96b000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788846017.435709:0:13011:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788846017.435784:0:13011:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788846017.435787:0:13011:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788846017.435790:0:13011:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788846017.435793:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846017.435795:0:13011:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788846017.435814:0:13011:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9a0c10183800 355d8611-f7e8-4bd6-8079-f3ef5a03a561 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788846017.435819:0:13011:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9a0c089a0000) has exports, disconnecting them 00000020:00080000:2.0:1788846017.435836:0:13011:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a0c10183800), last request at 1788845822 00000020:00000080:2.0:1788846017.435849:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ec0b 00000020:00010000:2.0:1788846017.435853:0:13011:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a0c10183800: total 2 00000100:00080000:2.0:1788846017.435857:0:13011:0:(import.c:65:import_set_state_nolock()) ffff9a0c10180800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788846017.435878:0:13011:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a0c10183800): rc 0 00000020:00080000:2.0:1788846017.435882:0:13011:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9a0c089a0000) has no exports 00000020:00010000:1.0:1788846017.435989:0:5833:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a0c10183800: total 2 00010000:00010000:1.0:1788846017.436018:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a0c10183800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788846017.436042:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c12f56000/0x1345bc80c773ef37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773ef30 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846017.436063:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c12f56400/0x1345bc80c773ef29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773ef22 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846017.436087:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c34a00800/0x1345bc80c773f160 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773f159 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846017.436098:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02824200/0x1345bc80c773ed15 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773ed0e expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846017.436109:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c3ebcf600/0x1345bc80c773ef61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773ef5a expref: 5 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846017.436130:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c02824e00/0x1345bc80c773f16e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773f167 expref: 4 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846017.436145:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01475e00/0x1345bc80c773ef0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773ef06 expref: 3 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846017.436177:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01475c00/0x1345bc80c773ef1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1345bc80c773ef14 expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846017.436186:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a0c10183800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788846017.436197:0:5833:0:(genops.c:885:class_export_put()) final put ffff9a0c10183800/355d8611-f7e8-4bd6-8079-f3ef5a03a561 00010000:00010000:1.0:1788846017.436206:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846017.436208:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846017.436210:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788846017.436262:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0b04977800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788846017.436269:0:8:0:(genops.c:885:class_export_put()) final put ffff9a0b04975800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788846017.436272:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0b04975800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788846017.436278:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788846017.436403:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3da35800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788846017.436407:0:8:0:(genops.c:885:class_export_put()) final put ffff9a0c0fbc0000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788846017.436409:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c0fbc0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788846017.436413:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788846017.436565:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3da37000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788846017.438061:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c10183800/355d8611-f7e8-4bd6-8079-f3ef5a03a561 for MGS 00000020:00000080:3.0:1788846017.438093:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c10180800 for MGS 00000100:00100000:1.0:1788846017.438242:0:5839:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a0c0746a400:5839] 1 exiting: rc = 0 00000100:00100000:3.0:1788846017.438421:0:5838:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a0c18569200:5838] 0 exiting: rc = 1 00000100:00100000:3.0:1788846017.438467:0:5840:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a0c18569000:5840] 2 exiting: rc = 0 00000100:00100000:1.0:1788846017.438682:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438691:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438696:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438703:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438709:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438715:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438730:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438736:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438744:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438749:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438754:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438759:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438764:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438770:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438775:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438780:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438785:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438791:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438795:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438808:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438813:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438819:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438825:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438830:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438836:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438841:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438847:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438852:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438857:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438863:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438870:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438875:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438881:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438886:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438892:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438897:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438903:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438909:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438914:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438919:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438924:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438937:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438943:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438949:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438954:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438959:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438965:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438970:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438974:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438980:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438985:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438990:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.438996:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.439002:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.439006:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.439012:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.439018:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.439023:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.439028:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.439034:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.439039:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.439045:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.439050:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.439056:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788846017.439749:0:13011:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788846017.439753:0:13011:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788846017.444500:0:13011:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a0c3cff1840 - data ffff9a0c2ab6d5e8/ffff9a0c2632e800 00000020:01000000:3.0:1788846017.444686:0:13011:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a0c0591c480 - data ffff9a0c2ab63438/ffff9a0c07b51400 00000020:00000080:3.0:1788846017.445255:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ebef 00000020:00000080:3.0:1788846017.445263:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c109ff000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788846017.445283:0:13011:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a0c0942a000 from MGS, refs=2 00000020:01000004:3.0:1788846017.445287:0:13011:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a0c0942a000 2 00000020:01000004:3.0:1788846017.445290:0:13011:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a0c0942a000 from MGS 00000020:00000080:1.0:1788846017.445336:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c109ff000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788846017.446008:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846017.446016:0:13011:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788846017.446020:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c109f9800/MGS 00000020:00000080:3.0:1788846017.446023:0:13011:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c109f9800/MGS for MGS 00000020:01000000:3.0:1788846017.446029:0:13011:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788846017.446080:0:13011:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788846017.446084:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846017.446089:0:13011:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788846017.446095:0:13011:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a0c3c969800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788846017.446102:0:13011:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9a0c347a3370) has exports, disconnecting them 00000020:00080000:3.0:1788846017.446106:0:13011:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a0c3c969800), last request at 1788845823 00000020:00000080:3.0:1788846017.446110:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ecba 00000020:00080000:3.0:1788846017.446123:0:13011:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a0c3c969800): rc 0 00000020:00000080:3.0:1788846017.446128:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c3c969800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788846017.446942:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3c969800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788846017.448233:0:13011:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788846017.448240:0:13011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788846017.448244:0:13011:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788846017.448250:0:13011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788846017.448397:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846017.448405:0:13011:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788846017.448410:0:13011:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a0c0942a000 1 00000020:00000080:2.0:1788846017.448416:0:13011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ebe1 00000020:00000080:2.0:1788846017.448424:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c109f8000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788846017.448429:0:13011:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788846017.448433:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846017.448436:0:13011:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788846017.448439:0:13011:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9a0c089a19b8) has no exports 00000020:00000080:1.0:1788846017.448498:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c3da33000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788846017.448505:0:37:0:(genops.c:885:class_export_put()) final put ffff9a0c3c96a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788846017.448507:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3c96a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788846017.448514:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788846017.448563:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c109f8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788846017.484696:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846017.484714:0:13011:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788846017.485633:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c06331800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788846017.485638:0:13011:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c06331800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788846017.485646:0:13011:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788846017.485741:0:13011:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a0c06333000 00000020:01000000:2.0:1788846017.485760:0:13011:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788846017.485765:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846017.485769:0:13011:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788846017.485773:0:13011:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9a0c089a4d28) has no exports 00000100:00100000:2.0:1788846017.485874:0:5846:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a0c109bd600:5846] 1 exiting: rc = 0 00000100:00100000:2.0:1788846017.485983:0:7134:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a0b04297800:7134] 3 exiting: rc = 0 00000100:00100000:3.0:1788846017.486481:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a0c20729c00:5845] 0 exiting: rc = 1 00000100:00100000:0.0:1788846017.486537:0:5847:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a0c20729400:5847] 2 exiting: rc = 0 00000100:00100000:2.0:1788846017.486935:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.486943:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.486948:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.486954:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.486959:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.486964:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.486970:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.486977:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.486982:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.486989:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.486995:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487000:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487005:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487010:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487016:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487021:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487026:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487030:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487036:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487041:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487046:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487063:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487069:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487075:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487091:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487098:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487104:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487110:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487116:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487122:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487128:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487134:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487139:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487145:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487176:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487181:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487186:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487191:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487196:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487202:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487208:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487213:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487219:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487226:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487232:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487237:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487243:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487249:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487254:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487259:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487264:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487269:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487275:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487281:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487287:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487293:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487301:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487307:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487314:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.487319:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.489991:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.490009:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.490014:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.490019:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.503389:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a0c2071c000:5849] 1 exiting: rc = 0 00000100:00100000:1.0:1788846017.505241:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a0c07b4b200:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1788846017.505476:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505485:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505492:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505498:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505505:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505522:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505530:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505542:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505551:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505564:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505569:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505576:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505582:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505588:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505593:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505610:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505623:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505629:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505635:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505639:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505644:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505648:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505653:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505657:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505662:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505666:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505670:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505675:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505680:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505685:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505689:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505694:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505699:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505704:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505710:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505714:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505719:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505724:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505729:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505733:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505748:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505755:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505764:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505772:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505779:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505791:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505796:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505810:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505815:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505820:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505825:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505831:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505838:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505845:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505851:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.505858:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.506334:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.506341:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.506419:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.506426:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.506436:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.506447:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.506457:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.506466:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.507312:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a0c2071c800:5850] 0 exiting: rc = 1 00000100:00100000:1.0:1788846017.507425:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a0c2071d800:5851] 1 exiting: rc = 0 00000100:00100000:2.0:1788846017.507591:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507619:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507628:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507634:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507639:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507645:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507651:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507657:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507665:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507674:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507682:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507696:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507706:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507714:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507746:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507754:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507761:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507768:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507775:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507782:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507790:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507810:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507819:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507826:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507834:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507841:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507883:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507890:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507895:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507901:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507906:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507912:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507917:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507923:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507935:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507942:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507948:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507955:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507974:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507981:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507986:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507991:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.507996:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508002:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508007:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508013:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508027:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508032:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508037:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508045:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508282:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508290:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508296:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508302:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508308:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508314:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508321:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508340:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508411:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508420:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508427:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508436:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508450:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.508460:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.522967:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a0c2071cc00:5852] 0 exiting: rc = 1 00000100:00100000:0.0:1788846017.523051:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a0c109bd800:5853] 1 exiting: rc = 0 00000100:00100000:3.0:1788846017.523538:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523547:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523556:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523565:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523574:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523594:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523601:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523606:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523612:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523616:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523621:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523626:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523631:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523636:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523645:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523739:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523746:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523751:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523756:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523761:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523766:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523771:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523776:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523781:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523786:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523790:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523796:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523813:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523819:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523824:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523828:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523833:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523838:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523842:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523847:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523852:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523857:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523862:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523866:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523871:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523885:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523889:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523893:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523897:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523901:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523906:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523910:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523914:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523918:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523923:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523928:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523932:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523937:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523941:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523946:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523951:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523956:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523960:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523965:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523970:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523974:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523978:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523983:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846017.523987:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.526038:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a0c088ff200:5855] 1 exiting: rc = 0 00000100:00100000:0.0:1788846017.526246:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a0c07b4b800:5854] 0 exiting: rc = 1 00000100:00100000:0.0:1788846017.532299:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532309:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532314:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532319:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532325:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532330:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532335:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532340:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532345:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532350:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532356:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532361:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532366:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532397:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532402:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532406:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532411:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532416:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532421:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532426:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532429:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532433:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532436:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532439:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532443:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532445:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532448:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532451:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532454:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532457:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532459:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532462:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532474:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532477:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532480:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532483:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532487:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532490:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532493:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532495:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532498:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532501:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532504:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532507:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532510:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532513:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532516:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532519:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532528:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532531:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532535:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532540:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532545:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532550:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532554:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532559:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532564:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532569:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532574:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532579:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532584:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532589:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532593:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.532598:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846017.533061:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a0c088ffc00:5857] 1 exiting: rc = 0 00000100:00100000:1.0:1788846017.533129:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a0c088fe200:5856] 0 exiting: rc = 1 00000100:00100000:0.0:1788846017.533978:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.533984:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.533989:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.533993:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.533997:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534001:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534006:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534012:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534017:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534022:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534027:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534033:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534038:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534043:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534048:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534054:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534058:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534063:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534068:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534093:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534099:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534104:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534751:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534763:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534769:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534774:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534779:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534783:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534789:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534794:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534808:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534813:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534818:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534823:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534828:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534832:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534836:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534841:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534846:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534851:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534855:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534860:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534865:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534870:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534875:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534880:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534885:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534890:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534894:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534898:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534903:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534907:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534913:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534917:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534930:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534936:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534941:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534946:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534952:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534957:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534962:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534967:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534971:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.534976:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846017.539113:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a0c07e1c600:5858] 0 exiting: rc = 1 00000100:00100000:2.0:1788846017.542790:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a0c07e1d600:5859] 1 exiting: rc = 0 00000100:00100000:3.0:1788846017.543851:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a0c07e1c800:5860] 2 exiting: rc = 0 00000100:00100000:0.0:1788846017.544125:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544132:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544140:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544146:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544441:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544450:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544456:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544461:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544467:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544472:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544476:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544482:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544487:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544492:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544496:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544501:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544506:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544511:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544516:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544521:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544540:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544546:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544551:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544556:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544561:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544581:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544587:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544592:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544598:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544603:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544609:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544616:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544622:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544626:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544631:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544636:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544641:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544645:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544650:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544656:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544662:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544667:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544672:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544678:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544697:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544703:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544708:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544712:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544717:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544722:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544727:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544732:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544737:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544743:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544749:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544755:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544760:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544783:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544789:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544794:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544815:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544820:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544826:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846017.544837:0:13011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788846017.549700:0:13011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846017.549712:0:13011:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788846017.549717:0:13011:0:(genops.c:885:class_export_put()) final put ffff9a0c18545000/MDS_uuid 00000020:00000080:0.0:1788846017.549721:0:13011:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c18545000/MDS_uuid for MDS 00000020:01000000:0.0:1788846017.549730:0:13011:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788846017.549862:0:13011:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788846018.214309:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846019.241611:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788846020.010305:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788846020.010312:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788846020.010315:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d8b5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846020.010322:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 347 00000100:00080000:3.0:1788846020.010328:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1788846020.010407:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739056512:0@lo:400:kworker.0 00000400:00000100:2.0:1788846020.010455:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875740739056512 offset 0 length 224: 4 00000100:00080000:3.0:1788846020.010887:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a0c3d8b5000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1788846020.010910:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3d52b100 x1875740739056640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788846020.010944:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788846020.010957:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788846020.010959:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a0b04969000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846020.010963:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 347 00000100:00080000:3.0:1788846020.010965:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788846020.010969:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a0b04969000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1788846020.010982:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3d52aa00 x1875740739056768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846020.011094:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875740739056640:0@lo:38:kworker.0 00000400:00000100:2.0:1788846020.011118:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875740739056640 offset 0 length 520: 4 00000100:00100000:2.0:1788846020.011131:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875740739056768:0@lo:38:kworker.0 00000400:00000100:2.0:1788846020.011145:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875740739056768 offset 0 length 520: 4 00000020:01000004:2.0:1788846020.194853:0:13164:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788846020.215417:0:13164:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788846020.215472:0:13164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846020.215507:0:13164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846020.215514:0:13164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846020.215520:0:13164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846020.215540:0:13164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788846020.215545:0:13164:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788846020.215566:0:13164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788846020.215577:0:13164:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a0c3d52b100 x1875740739056640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788846035 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846020.215597:0:13164:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788846020.215603:0:13164:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788846020.215609:0:13164:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d8b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788846020.215614:0:13164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788846020.215617:0:13164:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a0c3d52b100 x1875740739056640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788846035 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846020.215624:0:13164:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788846020.215627:0:13164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788846020.215764:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846020.215772:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846020.215780:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f56c00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:1.0:1788846020.215783:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846020.215802:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846020.215809:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846020.215816:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788846020.215818:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788846020.215820:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788846020.215856:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846020.215863:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788846020.215890:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846020.215896:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c12f56c00/0x1345bc80c773ef22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ef29 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846020.215919:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846020.215921:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846020.215923:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846020.215968:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788846020.215983:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739056896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788846020.216057:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846020.216220:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739056896 00000100:00100000:1.0:1788846020.216227:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739056896 00000100:00100000:1.0:1788846020.216275:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788846020.216282:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3310:x1875740739056896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788846020.216288:0:6705:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788846020 with bad export cookie 1388723321401764875 00000100:00100000:3.0:1788846020.217022:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875740739056640:0@lo:38:kworker.0 00010000:00010000:2.0:1788846020.218890:0:13164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846020.218906:0:13164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846020.218931:0:13164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846020.218936:0:13164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846020.218959:0:13164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846020.218966:0:13164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846020.218972:0:13164:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846020.218978:0:13164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846020.218983:0:13164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846020.218998:0:13164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788846020.219002:0:13164:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788846020.219021:0:13164:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788846020.219025:0:13164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:3.0:1788846020.220127:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846020.220135:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.220144:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcea00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:3.0:1788846020.220147:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846020.220166:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846020.220168:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846020.220171:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846020.220175:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846020.220177:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcfc00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:0.0:1788846020.220180:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846020.220181:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788846020.220184:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788846020.220186:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788846020.220187:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788846020.220193:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846020.220198:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788846020.220199:0:6704:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788846020.220201:0:6704:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788846020.220220:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846020.220220:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.220234:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788846020.220234:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846020.220245:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.220251:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ef30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773ef37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846020.220257:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.220263:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846020.220263:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcfc00/0x1345bc80c773f167 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1345bc80c773f16e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.220265:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846020.220267:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846020.220271:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846020.220273:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846020.220275:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846020.220280:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788846020.220294:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739057152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846020.220353:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846020.220397:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739057024:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788846020.220406:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000100:00100000:3.0:1788846020.220417:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846020.220443:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739057152 00000020:00000080:2.0:1788846020.220443:0:13164:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788846020.220447:0:13164:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9a0c3517b370) has no exports 00000100:00100000:3.0:1788846020.220449:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739057152 00000100:00100000:3.0:1788846020.220488:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739057024 00000100:00100000:3.0:1788846020.220491:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739057024 00000100:00100000:3.0:1788846020.220503:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788846020.220509:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c02d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1875740739057152:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788846020.220515:0:5831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788846020 with bad export cookie 1388723321401764875 00000100:00100000:3.0:1788846020.220554:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c02d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1875740739057152:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (201us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788846020.220561:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788846020.220575:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788846020.220579:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1875740739057024:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788846020.220588:0:5831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788846020 with bad export cookie 1388723321401764875 00000100:00100000:3.0:1788846020.220628:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1875740739057024:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (209us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788846020.220635:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788846020.220662:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788846020.220666:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9a0c18460800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788846020.220669:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00080000:2.0:1788846020.220746:0:13164:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9a0c3517b370) has no exports 00000020:01000000:2.0:1788846020.228624:0:13164:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a0c077ed660 - data ffff9a0c1ebdc6c0/ffff9a0c3d447000 00000020:01000000:2.0:1788846020.228774:0:13164:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a0c263a6c00 - data ffff9a0c1eb57288/ffff9a0b04825000 00000100:00100000:1.0:1788846020.232524:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3310:x1875740739056896:12345-0@lo:103:ldlm_bl.0 Request processed in 16013us (16239us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788846020.232540:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788846020.235445:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788846020.251561:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.148@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788846020.251567:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788846020.251576:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a0c3d528e00 x1875740739056512/t0(0) o400->MGC192.168.206.148@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788846036 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846020.251604:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a0c3d675f80 x1875740739056896/t0(0) o103->MGC192.168.206.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788846036 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846020.251772:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a0c3d672d80 x1875740739057152/t0(0) o103->MGC192.168.206.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788846036 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846020.251781:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a0c3d52b100 x1875740739057024/t0(0) o103->MGC192.168.206.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788846036 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788846020.251838:0:3310:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a0c18460800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1788846020.251850:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3308:1875740739056512:0@lo:400:kworker.0 10000000:01000000:3.0:1788846020.252017:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788846020.252021:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788846020.252022:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788846020.252026:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9a0c18460800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846020.252031:0:3309:0:(import.c:510:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 154 00000100:00080000:3.0:1788846020.252038:0:3309:0:(import.c:624:import_select_connection()) MGC192.168.206.148@tcp: import ffff9a0c18460800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1788846020.252120:0:3309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0b05929f80 x1875740739057280/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846020.252177:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739057024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846020.252190:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3309:1875740739057152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846020.252298:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3306:1875740739057280:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1788846020.252350:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875740739057280 offset 0 length 520: 4 00000100:00100000:1.0:1788846020.254626:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3310:1875740739056896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846020.264562:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788846020.265286:0:13164:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788846020.321730:0:13164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ed31 00000020:00000080:2.0:1788846020.321739:0:13164:0:(genops.c:885:class_export_put()) final put ffff9a0c3d8b6000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788846020.321759:0:13164:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a0c3c96b800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788846020.321762:0:13164:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a0c3c96b800 2 00000020:01000004:2.0:1788846020.321765:0:13164:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a0c3c96b800 from lustre-OST0000 00000020:00000080:2.0:1788846020.321798:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846020.321807:0:13164:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788846020.321810:0:13164:0:(genops.c:885:class_export_put()) final put ffff9a0c3d8b1000/lustre-OST0000_UUID 00000020:00000080:2.0:1788846020.321812:0:13164:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3d8b1000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788846020.321819:0:13164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788846020.321855:0:13164:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788846020.321860:0:13164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788846020.321864:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846020.321868:0:13164:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788846020.321874:0:13164:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a0c3d8b4000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788846020.321879:0:13164:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff9a0c351799b8) has exports, disconnecting them 00000020:00080000:2.0:1788846020.321884:0:13164:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a0c3d8b4000), last request at 1788845837 00000020:00000080:2.0:1788846020.321887:0:13164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ed85 00000020:00080000:2.0:1788846020.321896:0:13164:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a0c3d8b4000): rc 0 00000020:00000080:2.0:1788846020.321900:0:13164:0:(genops.c:885:class_export_put()) final put ffff9a0c3d8b4000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788846020.325976:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3d8b6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788846020.326012:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3d8b4000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788846020.326111:0:13164:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788846020.326116:0:13164:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788846020.326120:0:13164:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788846020.326127:0:13164:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788846020.326147:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c3d8b5000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788846020.326306:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846020.326314:0:13164:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788846020.326319:0:13164:0:(genops.c:885:class_export_put()) final put ffff9a0b0496c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788846020.326322:0:13164:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0b0496c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788846020.326326:0:13164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788846020.326389:0:13164:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a0c3c96b800 1 00000020:00000080:3.0:1788846020.326394:0:13164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773eceb 00000020:00000080:3.0:1788846020.326400:0:13164:0:(genops.c:885:class_export_put()) final put ffff9a0c3536d800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788846020.326409:0:13164:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788846020.326416:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3536d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788846020.326426:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846020.326430:0:13164:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788846020.326434:0:13164:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9a0c347a19b8) has no exports 00000020:00000080:0.0:1788846020.341585:0:13164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846020.341597:0:13164:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788846020.341603:0:13164:0:(genops.c:885:class_export_put()) final put ffff9a0c3536d000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788846020.341607:0:13164:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3536d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788846020.341614:0:13164:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788846020.341727:0:13164:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a0c0fbc1800 00000020:02000400:0.0:1788846020.341772:0:13164:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788846021.287930:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846022.311811:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788846022.776477:0:13315:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788846022.792478:0:13315:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788846022.792551:0:13315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.792567:0:13315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.792574:0:13315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.792596:0:13315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.792610:0:13315:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788846022.792615:0:13315:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1788846022.792941:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846022.792949:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.792955:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824800 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:3.0:1788846022.792959:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.792967:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846022.792985:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846022.792990:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788846022.792993:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788846022.792995:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788846022.793006:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a0c18460800 00010000:00010000:3.0:1788846022.793010:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.793015:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c02824800/0x1345bc80c773ef06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1345bc80c773ef0d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.793026:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846022.793028:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846022.793030:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788846022.796519:0:13315:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788846022.796537:0:13315:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a0c3d52aa00 x1875740739056768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788846035 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846022.796560:0:13315:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788846022.796565:0:13315:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788846022.796571:0:13315:0:(import.c:65:import_set_state_nolock()) ffff9a0b04969000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788846022.796575:0:13315:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788846022.796579:0:13315:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a0c3d52aa00 x1875740739056768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788846035 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846022.796585:0:13315:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788846022.796588:0:13315:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1788846022.797399:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875740739056768:0@lo:38:kworker.0 00010000:00010000:3.0:1788846022.799328:0:13315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.799345:0:13315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.799353:0:13315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.799361:0:13315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.799376:0:13315:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846022.799391:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846022.799394:0:13315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846022.799398:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.799402:0:13315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846022.799405:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474800 already unused, calling callback (ffffffffc1ba4c20) 00010000:00010000:3.0:1788846022.799408:0:13315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846022.799410:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.799414:0:13315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846022.799418:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846022.799425:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846022.799442:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788846022.799445:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788846022.799457:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a0c18460800 00010000:00010000:1.0:1788846022.799461:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.799462:0:13315:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788846022.799466:0:13315:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788846022.799467:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c01474800/0x1345bc80c773ef14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1345bc80c773ef1b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846022.799469:0:13315:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:1.0:1788846022.799480:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846022.799483:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846022.799488:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c12f57400 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:1.0:1788846022.799491:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788846022.799494:0:13315:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00010000:00010000:1.0:1788846022.799497:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1788846022.799498:0:13315:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788846022.799503:0:13315:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:1.0:1788846022.799503:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846022.799508:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00000080:3.0:1788846022.799509:0:13315:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 10000000:01000000:1.0:1788846022.799510:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788846022.799511:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:3.0:1788846022.799512:0:13315:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a0c3eadb370) has no exports 00010000:00010000:1.0:1788846022.799515:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a0c18460800 00010000:00010000:1.0:1788846022.799518:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846022.799532:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c12f57400/0x1345bc80c773f159 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1345bc80c773f160 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788846022.799534:0:13315:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a0c3eadb370) has no exports 00010000:00010000:1.0:1788846022.799544:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846022.799546:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846022.800499:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846022.800539:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788846022.801199:0:13315:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a0c088203c0 - data ffff9a0c2ab6c000/ffff9a0c20677800 00000020:01000000:3.0:1788846022.801382:0:13315:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a0b05eb7780 - data ffff9a0c1e805e58/ffff9a0c3ccc9800 00100000:10000000:0.0:1788846022.823519:0:13315:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788846022.868593:0:13315:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ee0a 00000020:00000080:2.0:1788846022.868600:0:13315:0:(genops.c:885:class_export_put()) final put ffff9a0c352f9000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788846022.868653:0:13315:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a0c2067c000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788846022.868657:0:13315:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a0c2067c000 2 00000020:01000004:2.0:1788846022.868660:0:13315:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a0c2067c000 from lustre-OST0001 00000020:00000080:2.0:1788846022.868681:0:13315:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846022.868689:0:13315:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788846022.868692:0:13315:0:(genops.c:885:class_export_put()) final put ffff9a0c352fe800/lustre-OST0001_UUID 00000020:00000080:2.0:1788846022.868694:0:13315:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c352fe800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788846022.868700:0:13315:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788846022.868807:0:13315:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 355d8611-f7e8-4bd6-8079-f3ef5a03a561->MGS 00010000:00010000:2.0:1788846022.868820:0:13315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c00031400/0x1345bc80c773ed0e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1345bc80c773ed15 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846022.868832:0:13315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c00031400/0x1345bc80c773ed0e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1345bc80c773ed15 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846022.868842:0:13315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788846022.868844:0:13315:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788846022.868847:0:13315:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788846022.868863:0:13315:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a0c18460800 00010000:00010000:2.0:1788846022.868867:0:13315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c00031400/0x1345bc80c773ed0e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1345bc80c773ed15 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.868882:0:13315:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c773ef5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1345bc80c773ef61 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846022.868889:0:13315:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c773ef5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1345bc80c773ef61 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846022.868916:0:13315:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788846022.869251:0:13315:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788846022.869253:0:13315:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788846022.869263:0:13315:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a0c18460800 00010000:00010000:2.0:1788846022.869267:0:13315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c773ef5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1345bc80c773ef61 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788846022.869284:0:13315:0:(import.c:65:import_set_state_nolock()) ffff9a0c18460800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788846022.869288:0:13315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788846022.869290:0:13315:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788846022.869291:0:13315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788846022.869295:0:13315:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788846022.869305:0:13315:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a0b05929f80 x1875740739057280/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788846030 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788846022.869323:0:13315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788846022.869325:0:13315:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:0.0:1788846022.870200:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:355d8611-f7e8-4bd6-8079-f3ef5a03a561:3306:1875740739057280:0@lo:250:ptlrpcd_00_02.0 00000020:00000080:1.0:1788846022.870507:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c352f9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:2.0:1788846022.870747:0:13315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788846022.870758:0:13315:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ebfd 00000020:00000080:2.0:1788846022.870766:0:13315:0:(genops.c:885:class_export_put()) final put ffff9a0c18547800/355d8611-f7e8-4bd6-8079-f3ef5a03a561 00000020:01000000:2.0:1788846022.870794:0:13315:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.148@tcp (flags='') 00000020:00000080:2.0:1788846022.870800:0:13315:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846022.870823:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c18547800/355d8611-f7e8-4bd6-8079-f3ef5a03a561 for MGC192.168.206.148@tcp 00000020:00000080:2.0:1788846022.870924:0:13315:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.148@tcp: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788846022.870930:0:13315:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9a0c088c4d28) has no exports 10000000:01000000:0.0:1788846022.871174:0:5842:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788846022.871220:0:13315:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.148@tcp: client import never connected 00000100:00080000:2.0:1788846022.871224:0:13315:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788846022.871228:0:13315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788846022.871230:0:13315:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788846022.871233:0:13315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788846022.871500:0:13315:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846022.871507:0:13315:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.148@tcp (uuid 355d8611-f7e8-4bd6-8079-f3ef5a03a561) 00000020:01000000:2.0:1788846022.871513:0:13315:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788846022.871527:0:13315:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846022.871531:0:13315:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788846022.871541:0:13315:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a0c3d13f800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788846022.871546:0:13315:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9a0b06a219b8) has exports, disconnecting them 00000020:00080000:2.0:1788846022.871551:0:13315:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a0c3d13f800), last request at 1788845858 00000020:00000080:2.0:1788846022.871555:0:13315:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773ee34 00000020:00080000:2.0:1788846022.871569:0:13315:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a0c3d13f800): rc 0 00000020:00000080:2.0:1788846022.871573:0:13315:0:(genops.c:885:class_export_put()) final put ffff9a0c3d13f800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788846022.872864:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0c18460800 for MGC192.168.206.148@tcp 00000020:00000080:1.0:1788846022.872877:0:36:0:(genops.c:885:class_export_put()) final put ffff9a0c18461000/355d8611-f7e8-4bd6-8079-f3ef5a03a561 00000020:00000080:1.0:1788846022.872880:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c18461000/355d8611-f7e8-4bd6-8079-f3ef5a03a561 for MGC192.168.206.148@tcp 00000020:01000000:1.0:1788846022.872888:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.148@tcp (355d8611-f7e8-4bd6-8079-f3ef5a03a561) 00000020:00000080:1.0:1788846022.873722:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3d13f800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788846022.876297:0:13315:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788846022.876304:0:13315:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788846022.876308:0:13315:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788846022.876315:0:13315:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788846022.876413:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a0b04969000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788846022.876626:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788846022.880052:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788846022.882181:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788846022.882351:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a0c079c5400:5829] 1 exiting: rc = 0 00000100:00100000:1.0:1788846022.882370:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a0c0746d400:5828] 0 exiting: rc = 1 00000100:00100000:2.0:1788846022.886391:0:8507:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9a0c3ebfac00:8507] 2 exiting: rc = 0 00000100:00100000:0.0:1788846022.886570:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.886926:0:5832:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a0c26aff600:5832] 2 exiting: rc = 0 00000100:00100000:1.0:1788846022.887002:0:5831:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a0c26afe600:5831] 1 exiting: rc = 0 00000100:00100000:1.0:1788846022.887062:0:6705:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a0b043fa800:6705] 3 exiting: rc = 0 00000100:00100000:2.0:1788846022.887242:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a0c079c4e00:5830] 0 exiting: rc = 1 00000100:00100000:0.0:1788846022.887348:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887366:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887373:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887378:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887385:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887391:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887397:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887402:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887408:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887414:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887611:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887621:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887627:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887632:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887637:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887647:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887653:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887659:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887663:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887668:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887674:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887678:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887683:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887687:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887692:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887697:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887702:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887707:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887712:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887717:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887721:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887725:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887729:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887733:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887738:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887742:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887794:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887800:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887805:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887814:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887820:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887825:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887830:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887835:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887840:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887844:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887849:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887853:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887858:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887862:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887870:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887875:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887880:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887884:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887889:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887893:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887898:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887902:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887906:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887911:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887915:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887919:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887923:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.887927:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788846022.888716:0:13315:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846022.888724:0:13315:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788846022.888729:0:13315:0:(genops.c:885:class_export_put()) final put ffff9a0c3d13e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788846022.888732:0:13315:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3d13e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788846022.888736:0:13315:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788846022.888813:0:13315:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a0c2067c000 1 00000020:00000080:0.0:1788846022.888824:0:13315:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1345bc80c773edd9 00000020:00000080:0.0:1788846022.888829:0:13315:0:(genops.c:885:class_export_put()) final put ffff9a0c3d13c000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788846022.888839:0:13315:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788846022.888843:0:13315:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846022.888848:0:13315:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788846022.888851:0:13315:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9a0c347a4d28) has no exports 00000020:00000080:1.0:1788846022.888899:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3d13c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788846022.901227:0:13315:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846022.901240:0:13315:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788846022.901245:0:13315:0:(genops.c:885:class_export_put()) final put ffff9a0c2067a000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788846022.901250:0:13315:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c2067a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788846022.901259:0:13315:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788846022.901767:0:13315:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a0c2067d800 00000020:01000000:0.0:1788846022.901795:0:13315:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788846022.901799:0:13315:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846022.901803:0:13315:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788846022.901807:0:13315:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9a0c347a0000) has no exports 00000020:00000080:0.0:1788846022.901825:0:13315:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846022.901830:0:13315:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788846022.901833:0:13315:0:(genops.c:885:class_export_put()) final put ffff9a0c3536f000/OSS_uuid 00000020:00000080:0.0:1788846022.901835:0:13315:0:(genops.c:844:class_export_destroy()) destroying export ffff9a0c3536f000/OSS_uuid for OSS 00000020:01000000:0.0:1788846022.901838:0:13315:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788846022.901935:0:5841:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788846022.902016:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a0c0752aa00:6689] 1 exiting: rc = 0 00000100:00100000:2.0:1788846022.902057:0:8094:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a0c3d209000:8094] 3 exiting: rc = 0 00000100:00100000:1.0:1788846022.902057:0:11681:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9a0c06b7de00:11681] 4 exiting: rc = 0 00000100:00100000:1.0:1788846022.902124:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a0c059f5000:6690] 2 exiting: rc = 0 00000100:00100000:1.0:1788846022.902286:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a0c07742800:6688] 0 exiting: rc = 1 00000100:00100000:0.0:1788846022.902377:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902385:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902391:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902397:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902402:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902407:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902413:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902417:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902433:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902440:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902445:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902450:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902456:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902466:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902471:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902477:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902481:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902486:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902491:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902496:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902502:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902507:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902512:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902517:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902522:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902529:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902536:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902541:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902549:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902554:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902560:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902565:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902570:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902574:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902579:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902584:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902589:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902594:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902599:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902603:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902609:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902613:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902618:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902623:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902628:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902632:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902637:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902642:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902652:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902658:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902662:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902667:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902672:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902677:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902682:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902686:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902691:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902698:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902703:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902709:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902713:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902718:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902722:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.902727:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846022.904069:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a0c353d9000:6691] 0 exiting: rc = 1 00000100:00100000:1.0:1788846022.904135:0:8920:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9a0c20672800:8920] 2 exiting: rc = 0 00000100:00100000:2.0:1788846022.904186:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a0c353d8000:6693] 1 exiting: rc = 0 00000100:00100000:0.0:1788846022.904296:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904302:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904307:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904312:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904328:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904333:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904339:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904344:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904349:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904354:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904359:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904364:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904369:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904373:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904385:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904391:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904397:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904402:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904406:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904435:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904440:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904445:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904450:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904455:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904460:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904466:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904471:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904476:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904480:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904485:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904490:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904496:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904501:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904507:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904512:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904517:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904522:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904527:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904532:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904538:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904542:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904547:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904552:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904557:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904562:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904568:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904573:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904578:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904583:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904588:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904593:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904598:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904606:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904612:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904623:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904628:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904634:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904639:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904643:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904648:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904653:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904657:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904662:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.904668:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846022.905958:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a0c17cb4e00:6694] 0 exiting: rc = 1 00000100:00100000:1.0:1788846022.906057:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a0c059f5600:6696] 2 exiting: rc = 0 00000100:00100000:2.0:1788846022.906135:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a0c059f4600:6695] 1 exiting: rc = 0 00000100:00100000:0.0:1788846022.906213:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906220:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906233:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906241:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906248:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906255:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906262:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906268:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906277:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906286:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906293:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906299:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906303:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906306:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906310:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906313:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906317:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906321:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906326:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906331:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906336:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906341:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906346:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906351:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906357:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906373:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906378:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906397:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906404:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906409:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906415:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906421:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906426:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906431:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906436:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906442:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906447:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906452:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906458:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906463:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906469:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906474:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906479:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906485:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906491:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906496:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906501:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906507:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906512:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906518:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906523:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906542:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906549:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906555:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906560:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906566:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906576:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906582:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906588:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906593:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906605:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906612:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906619:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.906623:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846022.911497:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a0c3d229400:6698] 1 exiting: rc = 0 00000100:00100000:3.0:1788846022.911534:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a0c17cb3a00:6697] 0 exiting: rc = 1 00000100:00100000:0.0:1788846022.911710:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911717:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911722:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911728:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911733:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911738:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911743:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911748:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911753:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911758:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911762:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911767:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911781:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911787:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911791:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911797:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911802:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911807:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911815:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911820:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911836:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911840:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911844:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911847:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911850:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911853:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911856:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911860:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911863:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911866:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911868:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911882:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911885:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911888:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911891:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911894:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911898:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911901:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911904:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911908:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911911:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911914:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911916:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911919:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911922:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911925:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911928:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911930:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911933:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911935:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911938:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911941:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911945:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911949:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911954:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911958:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911963:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911967:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911972:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911977:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911981:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911986:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911991:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.911996:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846022.912659:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a0c3d229e00:6699] 0 exiting: rc = 1 00000100:00100000:1.0:1788846022.912672:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a0c3d228000:6700] 1 exiting: rc = 0 00000100:00100000:0.0:1788846022.912761:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912767:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912795:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912800:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912806:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912811:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912816:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912822:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912839:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912846:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912856:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912861:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912867:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912872:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912877:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912882:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912888:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912893:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912899:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912905:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912925:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912933:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912939:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912961:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912967:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912973:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912979:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912988:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.912995:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913001:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913007:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913012:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913032:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913039:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913044:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913049:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913055:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913067:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913072:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913087:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913093:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913098:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913103:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913109:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913133:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913141:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913146:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913655:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913673:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913683:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913740:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913754:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913858:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913866:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913873:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913878:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913884:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913899:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913913:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913937:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913944:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913952:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913958:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846022.913972:0:13315:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788846022.920795:0:13315:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788846038.844630:0:13931:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788846047.630668:0:14392:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788846047.630785:0:14392:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788846047.630894:0:14392:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a0c3d38b000 00000020:01000004:2.0:1788846047.630907:0:14392:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788846047.630913:0:14392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788846047.630926:0:14392:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a0b06a20000) 00000020:00000080:2.0:1788846047.630937:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788846047.647077:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788846047.649813:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788846047.650366:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:2.0:1788846047.650471:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 403: rc = 0 00100000:10000000:2.0:1788846047.650569:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:2.0:1788846047.650864:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788846047.650932:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 403: rc = 0 00100000:10000000:2.0:1788846047.651029:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 403: rc = 0 00100000:10000000:2.0:1788846047.651124:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 403: rc = 0 00100000:10000000:2.0:1788846047.651616:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 405: rc = 0 00100000:10000000:2.0:1788846047.652922:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 769: rc = 0 00100000:10000000:2.0:1788846047.653011:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 769: rc = 0 00100000:10000000:2.0:1788846047.653650:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 777: rc = 0 00100000:10000000:2.0:1788846047.654472:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 777: rc = 0 00100000:10000000:2.0:1788846047.654799:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 777: rc = 0 00100000:10000000:3.0:1788846047.655539:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 777: rc = 0 00100000:10000000:3.0:1788846047.655896:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 777: rc = 0 00100000:10000000:3.0:1788846047.656132:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 777: rc = 0 00100000:10000000:3.0:1788846047.656779:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 777: rc = 0 00100000:10000000:3.0:1788846047.657039:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 777: rc = 0 00100000:10000000:3.0:1788846047.657555:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 777: rc = 0 00100000:10000000:3.0:1788846047.657879:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 777: rc = 0 00100000:10000000:3.0:1788846047.658124:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 777: rc = 0 00100000:10000000:3.0:1788846047.658656:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 777: rc = 0 00100000:10000000:3.0:1788846047.659137:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 655: rc = 0 00100000:10000000:3.0:1788846047.659666:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 655: rc = 0 00100000:10000000:3.0:1788846047.659970:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 655: rc = 0 00100000:10000000:3.0:1788846047.660463:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 655: rc = 0 00100000:10000000:3.0:1788846047.660863:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 655: rc = 0 00100000:10000000:3.0:1788846047.661207:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 655: rc = 0 00100000:10000000:3.0:1788846047.661626:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 655: rc = 0 00100000:10000000:3.0:1788846047.661954:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 655: rc = 0 00100000:10000000:3.0:1788846047.662585:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 655: rc = 0 00100000:10000000:3.0:1788846047.662917:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 655: rc = 0 00100000:10000000:0.0:1788846047.663616:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 655: rc = 0 00100000:10000000:0.0:1788846047.663952:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 655: rc = 0 00100000:10000000:0.0:1788846047.664537:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 655: rc = 0 00100000:10000000:0.0:1788846047.664872:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 655: rc = 0 00100000:10000000:0.0:1788846047.665401:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 655: rc = 0 00100000:10000000:0.0:1788846047.665635:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 655: rc = 0 00100000:10000000:0.0:1788846047.665962:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 655: rc = 0 00100000:10000000:0.0:1788846047.666568:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 655: rc = 0 00100000:10000000:0.0:1788846047.666894:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 655: rc = 0 00100000:10000000:0.0:1788846047.667502:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 655: rc = 0 00100000:10000000:0.0:1788846047.667862:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 655: rc = 0 00100000:10000000:0.0:1788846047.668540:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 655: rc = 0 00100000:10000000:0.0:1788846047.668888:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 655: rc = 0 00100000:10000000:0.0:1788846047.669481:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 655: rc = 0 00100000:10000000:0.0:1788846047.669813:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 655: rc = 0 00100000:10000000:0.0:1788846047.670057:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 655: rc = 0 00100000:10000000:0.0:1788846047.670438:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 655: rc = 0 00100000:10000000:0.0:1788846047.670699:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 655: rc = 0 00100000:10000000:0.0:1788846047.670926:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 655: rc = 0 00100000:10000000:0.0:1788846047.671208:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 655: rc = 0 00100000:10000000:0.0:1788846047.671443:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 655: rc = 0 00100000:10000000:0.0:1788846047.672412:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 655: rc = 0 00100000:10000000:0.0:1788846047.672855:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 546: rc = 0 00100000:10000000:0.0:1788846047.673811:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788846047.673961:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 774: rc = 0 00100000:10000000:0.0:1788846047.674664:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788846047.674813:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 774: rc = 0 00100000:10000000:0.0:1788846047.675004:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788846047.675148:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 774: rc = 0 00100000:10000000:0.0:1788846047.675830:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1788846047.675903:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 770: rc = 0 00100000:10000000:0.0:1788846047.676402:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1788846047.676486:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 770: rc = 0 00100000:10000000:0.0:1788846047.676953:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1788846047.677028:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 770: rc = 0 00000020:00000080:0.0:1788846047.677600:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788846047.677607:0:14392:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788846047.677615:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773fefe 00000020:01000004:0.0:1788846047.677622:0:14392:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788846047.677627:0:14392:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788846047.677631:0:14392:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a0c3d38b000 from MGS 00000020:01000004:0.0:1788846047.677634:0:14392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788846047.677655:0:14392:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a0c347a0000) 00000020:00000080:0.0:1788846047.677663:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788846047.677810:0:14392:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a0c3d38b000 from MGS, refs=2 00080000:01000000:0.0:1788846047.677815:0:14392:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788846047.677820:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773ff0c 00000100:00100000:0.0:1788846047.677910:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788846047.678034:0:14392:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788846047.678040:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788846047.679625:0:14392:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788846047.679635:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788846047.680564:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846047.680820:0:14392:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788846047.680826:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788846047.681508:0:14392:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788846047.681515:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788846047.681866:0:14392:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788846047.681871:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788846047.682770:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846047.682774:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846047.682776:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846047.683288:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846047.683291:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846047.683292:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846047.683968:0:14392:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788846047.686749:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788846047.697662:0:14392:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788846047.697751:0:14392:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788846047.697755:0:14392:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788846047.703475:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788846047.704468:0:14392:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788846047.704584:0:14392:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788846047.705990:0:14392:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788846047.707480:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846047.708354:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788846047.708363:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788846047.710770:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788846047.710781:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788846047.711535:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788846047.711543:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788846047.712330:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788846047.712351:0:14392:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.148@tcp' 00000020:01000004:0.0:1788846047.712352:0:14392:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788846047.712377:0:14392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.148@tcp (typ=mgc) 00000020:00000080:0.0:1788846047.712389:0:14392:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.148@tcp (ffff9a0c347a4d28) 00000020:00000080:0.0:1788846047.712403:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788846047.712473:0:14392:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a0c3d41f000@MGC192.168.206.148@tcp: add connection 192.168.206.148@tcp at head 00010000:00010000:0.0:1788846047.712611:0:14392:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.148@tcp-0 is initialized 00000040:01000000:0.0:1788846047.712618:0:14392:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788846047.714796:0:14407:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788846047.714886:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.148@tcp (uuid 3ac7e2af-29a9-4384-8c8c-a41d76049816) 00000020:00000080:0.0:1788846047.714908:0:14392:0:(genops.c:1385:class_connect()) connect: client 3ac7e2af-29a9-4384-8c8c-a41d76049816, cookie 0x1345bc80c773ff1a 00000100:00080000:0.0:1788846047.714918:0:14392:0:(import.c:510:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788846047.714924:0:14392:0:(import.c:624:import_select_connection()) MGC192.168.206.148@tcp: import ffff9a0c3d41f000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1788846047.714956:0:14392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3d670e00 x1875740739057408/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846047.714978:0:14392:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3ac7e2af-29a9-4384-8c8c-a41d76049816->MGS 00000020:01000004:0.0:1788846047.715003:0:14392:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788846047.715007:0:14392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788846047.715019:0:14392:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a0c347a19b8) 00000020:00000080:0.0:1788846047.715028:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1788846047.716582:0:14406:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1788846047.730531:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3ac7e2af-29a9-4384-8c8c-a41d76049816:3306:1875740739057408:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788846047.730600:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846047.731782:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739057408 00000100:00100000:2.0:1788846047.731793:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739057408 00000100:00100000:2.0:1788846047.731836:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846047.731845:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ccc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1875740739057408:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788846047.731871:0:14403:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3ac7e2af-29a9-4384-8c8c-a41d76049816@0@lo t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:2.0:1788846047.731900:0:14403:0:(genops.c:1385:class_connect()) connect: client 3ac7e2af-29a9-4384-8c8c-a41d76049816, cookie 0x1345bc80c773ff28 00000100:00080000:2.0:1788846047.732020:0:14403:0:(import.c:65:import_set_state_nolock()) ffff9a0c20727800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846047.732100:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ccc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+5:3306:x1875740739057408:12345-0@lo:250:mount.lustre.0 Request processed in 254us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846047.732108:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788846047.732827:0:3306:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788846047.732837:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.148@tcp: connect to target with instance 0 00000100:00080000:1.0:1788846047.732844:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788846047.732849:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788846047.732852:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c3d41f000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788846047.732854:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788846047.732871:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788846047.732877:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3ac7e2af-29a9-4384-8c8c-a41d76049816:3306:1875740739057408:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788846047.737388:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846047.737595:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788846047.737601:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788846047.742065:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788846047.742075:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788846047.743102:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788846047.743110:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788846047.744014:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788846047.744395:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788846047.744400:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788846047.744961:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788846047.744973:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788846047.781077:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846047.781555:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788846047.781561:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788846047.782912:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788846047.782922:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788846047.783804:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788846047.783971:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788846047.783976:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788846047.784622:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788846047.784629:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788846047.785398:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788846047.785560:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788846047.785565:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788846047.786116:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788846047.786123:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788846047.786941:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788846047.787096:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788846047.787101:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788846047.787839:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788846047.787846:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788846047.804825:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846047.805037:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788846047.805043:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788846047.806646:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788846047.806656:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788846047.807789:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788846047.807798:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788846047.808653:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788846047.808737:0:14392:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788846047.808743:0:14392:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788846047.808860:0:14392:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788846047.808892:0:14392:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788846047.808897:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788846047.808899:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788846047.808900:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846047.808901:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846047.808903:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846047.808904:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846047.808905:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788846047.808907:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788846047.808909:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846047.808910:0:14392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788846047.808912:0:14392:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788846047.808915:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788846047.808916:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788846047.808917:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846047.808918:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846047.808919:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846047.808920:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846047.808922:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788846047.808923:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788846047.808924:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846047.808925:0:14392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788846047.808964:0:14392:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788846047.808981:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739057536:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788846047.809045:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.809132:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200f2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788846047.809388:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739057536 00000100:00100000:2.0:1788846047.809396:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739057536 00000100:00100000:2.0:1788846047.809471:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788846047.809481:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ccca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+5:14392:x1875740739057536:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788846047.809526:0:14405:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788846047.809529:0:14405:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788846047.809532:0:14405:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788846047.809974:0:14426:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788846047.810788:0:14405:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788846047.811822:0:14427:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788846047.811832:0:14427:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788846047.811835:0:14427:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788846047.811870:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788846047.812122:0:14405:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788846047.812132:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788846047.816908:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ccca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+5:14392:x1875740739057536:12345-0@lo:253:mount.lustre.0 Request processed in 7421us (7855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846047.816927:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788846047.817020:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739057536:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788846047.817034:0:14392:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788846047.817037:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788846047.817039:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788846047.817040:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846047.817041:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846047.817042:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846047.817043:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846047.817045:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788846047.817046:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788846047.817048:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846047.817049:0:14392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788846047.817069:0:14392:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a0c3d38b000 from lustre-MDT0000 10000000:01000000:0.0:1788846047.817090:0:14392:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788846047.817093:0:14392:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788846047.817097:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a0c347a4d28 10000000:01000000:0.0:1788846047.817100:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788846047.817107:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a0c347a4d28 from 1 10000000:01000000:0.0:1788846047.817110:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788846047.817141:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773ff2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.817349:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773ff2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.817363:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773ff2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846047.817384:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739057664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788846047.817433:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.817466:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200f2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788846047.817528:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739057664 00000100:00100000:1.0:1788846047.817534:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739057664 00000100:00100000:1.0:1788846047.817612:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788846047.817621:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ccca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+5:14392:x1875740739057664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846047.817634:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846047.817665:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c34a00200/0x1345bc80c773ff36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ff2f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846047.817698:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c34a00200/0x1345bc80c773ff36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ff2f expref: 6 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846047.817709:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c34a00200/0x1345bc80c773ff36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ff2f expref: 6 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846047.817717:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34a00200, rc 0) 00000100:00100000:1.0:1788846047.817755:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ccca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+6:14392:x1875740739057664:12345-0@lo:101:mount.lustre.0 Request processed in 135us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846047.817761:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788846047.817830:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739057664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846047.817843:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773ff2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff36 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.817851:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773ff2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ff36 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846047.817898:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739057792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846047.817922:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.818122:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200f2240 going to sleep for 11 seconds 00000100:00100000:3.0:1788846047.818365:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739057792 00000100:00100000:3.0:1788846047.818370:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739057792 00000100:00100000:3.0:1788846047.818400:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788846047.818407:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ccca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+6:14392:x1875740739057792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846047.818616:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ccca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+6:14392:x1875740739057792:12345-0@lo:501:mount.lustre.0 Request processed in 209us (692us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788846047.818624:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788846047.818764:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739057792:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788846047.818795:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788846047.818809:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773ff2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff36 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.818818:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773ff2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff36 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846047.818826:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a0c3d38b000 10000000:01000000:0.0:1788846047.818841:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788846047.818846:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a0c3d38b000 10000000:01000000:0.0:1788846047.818848:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788846047.818851:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a0c3d38b000 from 1 10000000:01000000:0.0:1788846047.818853:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788846047.818874:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce200/0x1345bc80c773ff3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.818888:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce200/0x1345bc80c773ff3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.818896:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce200/0x1345bc80c773ff3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846047.818910:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739057920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788846047.818937:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.818959:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200f2240 going to sleep for 11 seconds 00000100:00100000:3.0:1788846047.819011:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739057920 00000100:00100000:3.0:1788846047.819016:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739057920 00000100:00100000:3.0:1788846047.819034:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788846047.819041:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ccc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+6:14392:x1875740739057920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846047.819048:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846047.819059:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475600/0x1345bc80c773ff44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ff3d expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846047.819076:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475600/0x1345bc80c773ff44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ff3d expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846047.819085:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475600/0x1345bc80c773ff44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ff3d expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846047.819093:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475600, rc 0) 00000100:00100000:3.0:1788846047.819131:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ccc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+7:14392:x1875740739057920:12345-0@lo:101:mount.lustre.0 Request processed in 90us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846047.819137:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788846047.819229:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739057920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846047.819240:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce200/0x1345bc80c773ff3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff44 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.819248:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce200/0x1345bc80c773ff3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ff44 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846047.819259:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788846047.819268:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce200/0x1345bc80c773ff3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff44 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.819397:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce200/0x1345bc80c773ff3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff44 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846047.819404:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788846047.819418:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788846047.819423:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a0c3d38b000 10000000:01000000:0.0:1788846047.819426:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788846047.819436:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788846047.819438:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788846047.819453:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ff4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.819459:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ff4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.819467:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ff4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846047.819479:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739058048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788846047.819503:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.819530:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200f2240 going to sleep for 11 seconds 00000100:00100000:3.0:1788846047.819583:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739058048 00000100:00100000:3.0:1788846047.819587:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739058048 00000100:00100000:3.0:1788846047.819605:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788846047.819611:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+7:14392:x1875740739058048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846047.819617:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846047.819634:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475000/0x1345bc80c773ff52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ff4b expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846047.819659:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475000/0x1345bc80c773ff52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ff4b expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846047.819668:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475000/0x1345bc80c773ff52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ff4b expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846047.819740:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475000, rc 0) 00000100:00100000:3.0:1788846047.819775:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+8:14392:x1875740739058048:12345-0@lo:101:mount.lustre.0 Request processed in 164us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846047.819781:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788846047.819847:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739058048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846047.819858:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ff4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff52 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.819866:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ff4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ff52 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846047.819902:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739058176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846047.819926:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.819947:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200f2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788846047.820011:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739058176 00000100:00100000:1.0:1788846047.820016:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739058176 00000100:00100000:1.0:1788846047.820037:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788846047.820044:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+8:14392:x1875740739058176:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846047.820554:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+9:14392:x1875740739058176:12345-0@lo:501:mount.lustre.0 Request processed in 509us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846047.820562:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788846047.820653:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739058176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846047.820756:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739058304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846047.820795:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.820829:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200f2240 going to sleep for 11 seconds 00000100:00100000:3.0:1788846047.820905:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739058304 00000100:00100000:3.0:1788846047.820910:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739058304 00000100:00100000:3.0:1788846047.820931:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788846047.820938:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+9:14392:x1875740739058304:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846047.821366:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+9:14392:x1875740739058304:12345-0@lo:503:mount.lustre.0 Request processed in 426us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846047.821373:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788846047.821474:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739058304:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788846047.821957:0:14428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d675f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ac7e2af-29a9-4384-8c8c-a41d76049816:14428:1875740739058432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788846047.821997:0:14428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846047.822026:0:14428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c222d39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846047.822071:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739058432 00000100:00100000:3.0:1788846047.822076:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739058432 00000100:00100000:3.0:1788846047.822107:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788846047.822114:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04825450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+9:14428:x1875740739058432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846047.822577:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04825450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+9:14428:x1875740739058432:12345-0@lo:502:llog_process_th.0 Request processed in 463us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846047.822585:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788846047.822742:0:14428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d675f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ac7e2af-29a9-4384-8c8c-a41d76049816:14428:1875740739058432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788846047.822769:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788846047.822780:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846047.822782:0:14428:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788846047.822787:0:14428:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788846047.822790:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788846047.822803:0:14428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a0c3ead99b8) 00000020:00000080:1.0:1788846047.822818:0:14428:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788846047.822824:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788846047.822893:0:14428:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788846047.822901:0:14428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773ff60 00000020:00000080:1.0:1788846047.823090:0:14428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788846047.823095:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788846047.823099:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846047.823100:0:14428:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788846047.823103:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788846047.823106:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846047.823107:0:14428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788846047.823110:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788846047.823122:0:14428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a0c3ead8000) 00000020:00000080:1.0:1788846047.823131:0:14428:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788846047.823136:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788846047.823137:0:14428:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788846047.823140:0:14428:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788846047.823145:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788846047.823381:0:14428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a0c3d38b000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788846047.823396:0:14428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a0c3eadb370) 00000020:00000080:1.0:1788846047.823405:0:14428:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788846047.823455:0:14428:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788846047.823461:0:14428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1345bc80c773ff75 00000020:00000080:1.0:1788846047.823544:0:14428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788846047.823550:0:14428:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788846047.823554:0:14428:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1345bc80c773ff7c 00080000:01000000:1.0:1788846047.823558:0:14428:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788846047.823562:0:14428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773ff83 00010000:00010000:3.0:1788846047.885114:0:14428:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788846047.885729:0:14428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788846047.885886:0:14428:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788846047.886500:0:14428:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a0c351799b8) 00000020:00000080:3.0:1788846047.886517:0:14428:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788846047.886585:0:14428:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788846047.886593:0:14428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773ff91 00000020:00000080:1.0:1788846047.888921:0:14428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788846047.896944:0:14428:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1345bc80c773ff98 00000020:00000080:3.0:1788846047.897589:0:14428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788846047.897600:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846047.897607:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846047.897609:0:14428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788846047.897613:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846047.897619:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846047.897620:0:14428:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788846047.897625:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788846047.897678:0:14428:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788846047.897694:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846047.897698:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846047.897700:0:14428:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788846047.897702:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788846047.897704:0:14428:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788846047.897706:0:14428:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788846047.897707:0:14428:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788846047.897708:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788846047.897711:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846047.897712:0:14428:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788846047.897714:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788846047.897717:0:14428:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788846047.897720:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846047.897721:0:14428:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788846047.897725:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788846047.897730:0:14428:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:3.0:1788846047.897755:0:14428:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788846047.897764:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788846047.897777:0:14428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a0c3517cd28) 00000020:00000080:3.0:1788846047.897789:0:14428:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788846047.897796:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788846047.897845:0:14428:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788846047.897850:0:14428:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788846047.897855:0:14428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773ffa6 00010000:00080000:3.0:1788846047.897883:0:14428:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a0c074be800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1788846047.898089:0:14428:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788846047.898677:0:14428:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788846047.898720:0:14428:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788846047.900868:0:14428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788846047.900949:0:14428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788846047.901021:0:14428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788846047.902968:0:14432:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788846047.902974:0:14432:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788846047.903950:0:14428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788846047.903961:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788846047.903993:0:14428:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788846047.904010:0:14428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1345bc80c773ffad 00000100:00080000:1.0:1788846047.904020:0:14428:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788846047.904026:0:14428:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a0c074be800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1788846047.904060:0:14428:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3d675f80 x1875740739058560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846047.904090:0:14428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788846047.904356:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788846047.904360:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846047.904362:0:14428:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788846047.904365:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788846047.904375:0:14428:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788846047.904377:0:14428:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788846047.904379:0:14428:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788846047.904381:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788846047.904383:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846047.904385:0:14428:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788846047.904388:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788846047.904391:0:14428:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788846047.904394:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846047.904396:0:14428:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788846047.904399:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788846047.904402:0:14428:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:1.0:1788846047.904426:0:14428:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788846047.904428:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788846047.904438:0:14428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a0c3eadcd28) 00000020:00000080:1.0:1788846047.904449:0:14428:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788846047.904453:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788846047.904502:0:14428:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788846047.904506:0:14428:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788846047.904512:0:14428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1345bc80c773ffbb 00010000:00080000:1.0:1788846047.904539:0:14428:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a0c3eb16800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.148@tcp at head 00000100:00100000:2.0:1788846047.904749:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739058560:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788846047.904803:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740739058560 offset 0 length 520: 4 00010000:00010000:1.0:1788846047.904964:0:14428:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788846047.905129:0:14428:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788846047.905178:0:14428:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788846047.906849:0:14428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788846047.907023:0:14428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788846047.907090:0:14428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788846047.907655:0:14434:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788846047.907659:0:14434:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788846047.908466:0:14428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788846047.908477:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788846047.908510:0:14428:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788846047.908527:0:14428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1345bc80c773ffc2 00000100:00080000:0.0:1788846047.908536:0:14428:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788846047.908541:0:14428:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a0c3eb16800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1788846047.908573:0:14428:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3d673480 x1875740739058688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846047.908602:0:14428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788846047.908654:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846047.908659:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846047.908661:0:14428:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788846047.908664:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:3.0:1788846047.908876:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739058688:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788846047.908929:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740739058688 offset 0 length 520: 4 00000020:00000080:0.0:1788846047.909009:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846047.909011:0:14428:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788846047.909018:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788846047.909019:0:14428:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788846047.909022:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846047.909024:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846047.909026:0:14428:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788846047.909029:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846047.909031:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846047.909033:0:14428:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788846047.909036:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788846047.909064:0:14428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ac7e2af-29a9-4384-8c8c-a41d76049816:14428:1875740739058816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788846047.909118:0:14428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.909221:0:14428:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200f2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788846047.909421:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739058816 00000100:00100000:2.0:1788846047.909428:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739058816 00000100:00100000:2.0:1788846047.909471:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788846047.909480:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+9:14428:x1875740739058816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788846047.909853:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+9:14428:x1875740739058816:12345-0@lo:502:llog_process_th.0 Request processed in 373us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846047.909863:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788846047.909934:0:14428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ac7e2af-29a9-4384-8c8c-a41d76049816:14428:1875740739058816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788846047.909968:0:14428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846047.909973:0:14428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846047.909975:0:14428:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788846047.909980:0:14428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788846047.910138:0:14392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788846047.910437:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788846047.910484:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ff4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff52 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846047.910495:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcea00/0x1345bc80c773ff4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff52 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846047.910504:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a0c3d38b000 from 1 10000000:01000000:2.0:1788846047.910507:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788846047.910534:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846047.910549:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846047.910560:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846047.910574:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739058944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846047.910605:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846047.910645:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c351bde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846047.910706:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739058944 00000100:00100000:3.0:1788846047.910711:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739058944 00000100:00100000:3.0:1788846047.910749:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788846047.910756:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+9:14392:x1875740739058944:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846047.910766:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846047.910779:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01474200/0x1345bc80c773ffd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ffc9 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846047.910811:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01474200/0x1345bc80c773ffd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ffc9 expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846047.910820:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01474200/0x1345bc80c773ffd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ffc9 expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846047.910839:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474200, rc 0) 00000100:00100000:3.0:1788846047.910948:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+10:14392:x1875740739058944:12345-0@lo:101:mount.lustre.0 Request processed in 192us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846047.910955:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788846047.911088:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739058944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846047.911100:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ffd0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846047.911109:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ffd0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846047.911960:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739059072:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788846047.912003:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846047.912066:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c351bde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788846047.912107:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739059072 00000100:00100000:1.0:1788846047.912113:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739059072 00000100:00100000:1.0:1788846047.912297:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788846047.912307:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+10:14392:x1875740739059072:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788846047.912321:0:14404:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788846047.912327:0:14404:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788846047.912389:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+10:14392:x1875740739059072:12345-0@lo:256:mount.lustre.0 Request processed in 84us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846047.912403:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788846047.912469:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739059072:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788846047.913030:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788846047.913053:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ffd0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846047.913064:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ffd0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846047.913119:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c3d38b000 from 1 10000000:01000000:2.0:1788846047.913122:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788846047.913147:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846047.913179:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846047.913197:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846047.913211:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739059200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846047.913242:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846047.913704:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c351bde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846047.913817:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739059200 00000100:00100000:3.0:1788846047.913824:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739059200 00000100:00100000:3.0:1788846047.913853:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788846047.913861:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+10:14392:x1875740739059200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846047.913870:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846047.913884:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ffde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ffd7 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846047.913904:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ffde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ffd7 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846047.913914:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ffde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ffd7 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846047.913922:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475800, rc 0) 00000100:00100000:3.0:1788846047.914000:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:14392:x1875740739059200:12345-0@lo:101:mount.lustre.0 Request processed in 140us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846047.914007:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788846047.914105:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739059200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846047.914118:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ffde expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846047.914127:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ffde expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846047.914367:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739059328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846047.914396:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846047.914453:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c351bde40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846047.914505:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739059328 00000100:00100000:0.0:1788846047.914510:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739059328 00000100:00100000:3.0:1788846047.914586:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788846047.914595:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:14392:x1875740739059328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846047.915061:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:14392:x1875740739059328:12345-0@lo:501:mount.lustre.0 Request processed in 466us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846047.915078:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788846047.915375:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739059328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846047.915412:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739059456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846047.915455:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846047.915477:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c351bde40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846047.915546:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739059456 00000100:00100000:0.0:1788846047.915551:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739059456 00000100:00100000:0.0:1788846047.915571:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788846047.915579:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:14392:x1875740739059456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846047.915920:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:14392:x1875740739059456:12345-0@lo:503:mount.lustre.0 Request processed in 340us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846047.915928:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788846047.915981:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739059456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846047.916521:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ac7e2af-29a9-4384-8c8c-a41d76049816:14436:1875740739059584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788846047.916560:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.916623:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200f2180 going to sleep for 11 seconds 00000100:00100000:3.0:1788846047.916662:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739059584 00000100:00100000:3.0:1788846047.916667:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739059584 00000100:00100000:3.0:1788846047.916794:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788846047.916802:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:14436:x1875740739059584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846047.916997:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:14436:x1875740739059584:12345-0@lo:502:llog_process_th.0 Request processed in 195us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846047.917004:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788846047.917072:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ac7e2af-29a9-4384-8c8c-a41d76049816:14436:1875740739059584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788846047.917094:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846047.917102:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846047.917104:0:14436:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788846047.917113:0:14436:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a0c3d38b000 00000020:00000080:0.0:1788846047.917115:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846047.917122:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846047.917124:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846047.917126:0:14436:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788846047.917128:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846047.917130:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846047.917132:0:14436:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788846047.917135:0:14436:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a0c3d38b000 00000020:00000080:0.0:1788846047.917143:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846047.917235:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846047.918770:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846047.918774:0:14436:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788846047.918784:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846047.918789:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846047.918790:0:14436:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788846047.918796:0:14436:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a0c3d38b000 00000020:00000080:0.0:1788846047.918799:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788846047.922541:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ac7e2af-29a9-4384-8c8c-a41d76049816:14436:1875740739059712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788846047.922616:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.922797:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200f23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846047.922881:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739059712 00000100:00100000:1.0:1788846047.922889:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739059712 00000100:00100000:1.0:1788846047.922942:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788846047.922952:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:14436:x1875740739059712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788846047.923245:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:14436:x1875740739059712:12345-0@lo:502:llog_process_th.0 Request processed in 230us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846047.923255:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788846047.923792:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ac7e2af-29a9-4384-8c8c-a41d76049816:14436:1875740739059712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788846047.923825:0:14436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846047.923832:0:14436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846047.923835:0:14436:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788846047.923842:0:14436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788846047.923986:0:14392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788846047.924006:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788846047.924026:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ffde expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846047.924036:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ffde expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846047.924077:0:14392:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788846047.924080:0:14392:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a0c3d38b000 10000000:01000000:1.0:1788846047.924082:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a0c3d38b000 10000000:01000000:1.0:1788846047.924086:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788846047.924092:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a0c3d38b000 from 1 10000000:01000000:1.0:1788846047.924094:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788846047.924122:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01c00/0x1345bc80c773ffe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846047.924129:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01c00/0x1345bc80c773ffe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846047.924138:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01c00/0x1345bc80c773ffe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846047.924740:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739059840:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788846047.924788:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846047.924825:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c2209f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788846047.924871:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739059840 00000100:00100000:0.0:1788846047.924877:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739059840 00000100:00100000:0.0:1788846047.924919:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788846047.924927:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:14392:x1875740739059840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846047.924939:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846047.924953:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c3ebcfc00/0x1345bc80c773ffec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c773ffe5 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.924977:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3ebcfc00/0x1345bc80c773ffec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c773ffe5 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.924987:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c3ebcfc00/0x1345bc80c773ffec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ffe5 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846047.925006:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcfc00, rc 0) 00000100:00100000:0.0:1788846047.925040:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14392:x1875740739059840:12345-0@lo:101:mount.lustre.0 Request processed in 113us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846047.925047:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788846047.925120:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739059840:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846047.925132:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01c00/0x1345bc80c773ffe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ffec expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846047.925142:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01c00/0x1345bc80c773ffe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c773ffec expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846047.933894:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739059968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846047.933955:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.933994:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739059968 00000100:00100000:0.0:1788846047.934001:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739059968 00000100:00100000:0.0:1788846047.935303:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788846047.935318:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14392:x1875740739059968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846047.935579:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14392:x1875740739059968:12345-0@lo:501:mount.lustre.0 Request processed in 265us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846047.935587:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788846047.940838:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200f2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788846047.940876:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739059968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846047.940926:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739060096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846047.940987:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.941015:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200f2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788846047.941418:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739060096 00000100:00100000:0.0:1788846047.941425:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739060096 00000100:00100000:0.0:1788846047.941470:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788846047.941479:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14392:x1875740739060096:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846047.941665:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14392:x1875740739060096:12345-0@lo:503:mount.lustre.0 Request processed in 186us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846047.941691:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788846047.941740:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739060096:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788846047.945881:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ac7e2af-29a9-4384-8c8c-a41d76049816:14441:1875740739060224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788846047.945959:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846047.945997:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739060224 00000100:00100000:1.0:1788846047.946004:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739060224 00000100:00100000:1.0:1788846047.946044:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788846047.946053:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14441:x1875740739060224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788846047.946503:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14441:x1875740739060224:12345-0@lo:502:llog_process_th.0 Request processed in 450us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846047.946511:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788846047.946563:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b30cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846047.946583:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ac7e2af-29a9-4384-8c8c-a41d76049816:14441:1875740739060224:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788846047.946650:0:14441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788846047.946726:0:14441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a0c3e150000) 00000020:00000080:1.0:1788846047.946746:0:14441:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788846047.946819:0:14441:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a0c3d38b000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788846047.946831:0:14441:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a0c3d38b000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788846047.946834:0:14441:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a0c3d38b000 4 00010000:00080000:1.0:1788846047.946871:0:14441:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a0c18542800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:1.0:1788846047.950866:0:14441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788846047.951069:0:14441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788846047.951106:0:14441:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788846047.951118:0:14441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1345bc80c773fffa 00000100:00080000:1.0:1788846047.951127:0:14441:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788846047.951133:0:14441:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a0c18542800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1788846047.951261:0:14441:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3d676a00 x1875740739060352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846047.951354:0:14441:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788846047.952788:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875740739060352:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846047.952855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846047.952935:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739060352 00000100:00100000:2.0:1788846047.952942:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739060352 00000100:00100000:2.0:1788846047.952975:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846047.952982:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0592aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875740739060352:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846047.953034:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0592aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875740739060352:12345-0@lo:38:llog_process_th.0 Request processed in 51us (178us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788846047.953041:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846047.953074:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846047.953081:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c18542800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846047.953085:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788846047.953089:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875740739060352:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788846047.953867:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d674a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ac7e2af-29a9-4384-8c8c-a41d76049816:14441:1875740739060480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788846047.953916:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846047.953934:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b30600 going to sleep for 11 seconds 00000100:00100000:3.0:1788846047.954097:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739060480 00000100:00100000:3.0:1788846047.954104:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739060480 00000100:00100000:3.0:1788846047.954143:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788846047.954373:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14441:x1875740739060480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846047.954653:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14441:x1875740739060480:12345-0@lo:502:llog_process_th.0 Request processed in 502us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846047.954661:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788846047.960233:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d674a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3ac7e2af-29a9-4384-8c8c-a41d76049816:14441:1875740739060480:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788846047.960770:0:14441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788846047.960895:0:14392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788846047.960916:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788846047.960936:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01c00/0x1345bc80c773ffe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ffec expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846047.960948:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01c00/0x1345bc80c773ffe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ffec expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788846047.960995:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788846047.960997:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788846047.960998:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846047.960999:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846047.961005:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846047.961007:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846047.961008:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788846047.961009:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788846047.961011:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846047.961012:0:14392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788846047.961016:0:14392:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788846047.961018:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788846047.961019:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788846047.961020:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846047.961021:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846047.961022:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846047.961023:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846047.961024:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788846047.961024:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788846047.961025:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846047.961026:0:14392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788846047.961057:0:14392:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788846047.961072:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d674a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739060608:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788846047.961131:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846047.961377:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739060608 00000100:00100000:2.0:1788846047.961384:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739060608 00000100:00100000:2.0:1788846047.961430:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788846047.961439:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14392:x1875740739060608:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788846047.961460:0:14405:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788846047.961470:0:14405:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788846047.961903:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b30600 going to sleep for 11 seconds 20000000:01000000:3.0:1788846047.999976:0:14405:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788846047.999993:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788846048.000060:0:14426:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788846048.000064:0:14426:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788846048.000085:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.000117:0:14426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c01474200/0x1345bc80c773ffd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ffc9 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.000125:0:14426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.000193:0:14426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c01474200/0x1345bc80c773ffd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ffc9 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.000208:0:14426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c01474200/0x1345bc80c773ffd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ffc9 expref: 12 pid: 14405 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846048.000223:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05928a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14426:1875740739060736:0@lo:104: 00000100:00100000:2.0:1788846048.000398:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846048.000437:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c26024780 going to sleep for 11 seconds 00000100:00100000:3.0:1788846048.000518:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739060736 00000100:00100000:3.0:1788846048.000525:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739060736 00000100:00100000:3.0:1788846048.000571:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788846048.000581:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0592ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3ac7e2af-29a9-4384-8c8c-a41d76049816+3:14426:x1875740739060736:12345-0@lo:104: 00010000:00010000:3.0:1788846048.000597:0:14393:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ffd0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.000659:0:14393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788846048.000665:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0592ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3ac7e2af-29a9-4384-8c8c-a41d76049816+3:14426:x1875740739060736:12345-0@lo:104: Request processed in 86us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846048.000747:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788846048.000767:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846048.000772:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ffd0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.000779:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c8200 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:3.0:1788846048.000782:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ffd0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.000789:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ffd0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846048.000796:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ffd0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846048.000801:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788846048.000827:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ffd0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.000834:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846048.000851:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ffd0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.000857:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c013c8200/0x1345bc80c773ffc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ffd0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.000872:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846048.000874:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846048.000876:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846048.000903:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ac7e2af-29a9-4384-8c8c-a41d76049816:3307:1875740739060864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846048.000936:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846048.000998:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739060864 00000100:00100000:3.0:1788846048.001003:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739060864 00010000:00010000:3.0:1788846048.001018:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c01474200/0x1345bc80c773ffd0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ffc9 expref: 13 pid: 14405 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846048.001038:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788846048.001044:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ac7e2af-29a9-4384-8c8c-a41d76049816+13:3307:x1875740739060864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846048.001054:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846048.001059:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c01474200/0x1345bc80c773ffd0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ffc9 expref: 13 pid: 14405 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.001069:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c01474200/0x1345bc80c773ffd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ffc9 expref: 13 pid: 14405 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.001083:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.001091:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788846048.001103:0:14395:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001039265s 00010000:00010000:3.0:1788846048.001107:0:14395:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.001114:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.001120:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.001136:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.001141:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c9e00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846048.001145:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.001351:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.001363:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.001372:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846048.001406:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ac7e2af-29a9-4384-8c8c-a41d76049816+13:3307:x1875740739060864:12345-0@lo:103:ldlm_bl.0 Request processed in 362us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846048.001412:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788846048.001461:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01474200/0x1345bc80c773ffd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ffc9 expref: 12 pid: 14405 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846048.001472:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05928a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14426:1875740739060736:0@lo:104: 00010000:00010000:3.0:1788846048.001488:0:14426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.001497:0:14426:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.001503:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846048.001520:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c7740001 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846048.001596:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ac7e2af-29a9-4384-8c8c-a41d76049816:3307:1875740739060864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788846048.010607:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:14392:x1875740739060608:12345-0@lo:253:mount.lustre.0 Request processed in 49161us (49467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846048.010621:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788846048.010768:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d674a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:14392:1875740739060608:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788846048.010782:0:14392:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788846048.010786:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788846048.010788:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788846048.010789:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846048.010790:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846048.010791:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846048.010793:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846048.010794:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788846048.010795:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788846048.010797:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846048.010798:0:14392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788846048.010813:0:14392:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788846048.016079:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788846048.016456:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788846048.016810:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788846048.016971:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788846048.017537:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788846048.017779:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788846048.019025:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788846048.019345:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788846048.019609:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788846048.019893:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788846048.020379:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788846048.020549:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788846048.045876:0:14392:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788846048.046468:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788846048.046810:0:14449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788846048.046876:0:14449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788846048.051732:0:14448:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788846048.051738:0:14448:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1788846048.051954:0:14449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788846048.052016:0:14449:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788846048.052020:0:14449:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1788846048.052369:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788846048.052510:0:14392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788846048.053114:0:14392:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788846048.053122:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788846048.053482:0:14392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788846048.054790:0:14392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788846048.055753:0:14392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788846048.055798:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788846048.056447:0:14392:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1788846048.057579:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788846048.063651:0:14392:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788846048.096113:0:14392:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788846048.096148:0:14392:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb360c1d8f988 00100000:10000000:0.0:1788846048.096246:0:14392:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788846048.097653:0:14392:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788846048.097769:0:14392:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788846048.097784:0:14392:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788846048.097802:0:14392:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788846048.744429:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788846048.999349:0:14442:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788846048.999359:0:14442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788846048.999757:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788846048.999776:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1788846049.703089:0:14407:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788846049.703097:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a0c3d38b000 from 6 10000000:01000000:0.0:1788846049.703103:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788846049.703147:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846049.703210:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846049.703234:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846049.703259:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739060992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788846049.703327:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846049.703384:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739060992 00000100:00100000:0.0:1788846049.703396:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c0653b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788846049.703458:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739060992 00000100:00100000:2.0:1788846049.703513:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788846049.703524:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:14407:x1875740739060992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846049.703539:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846049.703556:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c013c8200/0x1345bc80c774000f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c7740008 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846049.703584:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c013c8200/0x1345bc80c774000f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c7740008 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846049.703595:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c013c8200/0x1345bc80c774000f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c7740008 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846049.703604:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c013c8200, rc 0) 00000100:00100000:0.0:1788846049.703717:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739060992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788846049.703732:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774000f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846049.703741:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c774000f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846049.703791:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739061120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788846049.706718:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846049.706757:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c0653b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788846049.706777:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739061120 00000100:00100000:0.0:1788846049.706785:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739061120 00000100:00100000:0.0:1788846049.706821:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788846049.706829:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+13:14407:x1875740739061120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788846049.706848:0:14405:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788846049.706867:0:14405:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788846049.706869:0:14405:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788846049.706962:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+13:14407:x1875740739061120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846049.706970:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788846049.707011:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739061120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788846049.707052:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788846049.707061:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774000f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846049.707070:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774000f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846049.707487:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14407:x1875740739060992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3962us (4159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846049.707495:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788846049.771002:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788846050.022510:0:14442:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788846050.022520:0:14442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788846050.022557:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788846050.022563:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788846050.790306:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846051.828470:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846052.840742:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788846052.961323:0:14692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788846053.286399:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846053.286407:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846053.286409:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846053.286413:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846053.286415:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788846053.286418:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788846053.286421:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a0c18542800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846053.286432:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a0c18542800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1788846053.286466:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0b05929180 x1875740739061376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846053.286491:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846053.286501:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ac7e2af-29a9-4384-8c8c-a41d76049816:3307:1875740739061248:0@lo:400:kworker.0 00000100:00100000:2.0:1788846053.286570:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846053.286632:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739061248 00000100:00100000:2.0:1788846053.286640:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739061248 00000100:00100000:2.0:1788846053.286688:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788846053.286697:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:3307:x1875740739061248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846053.286745:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:3307:x1875740739061248:12345-0@lo:400:kworker.0 Request processed in 49us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846053.286752:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788846053.286781:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875740739061376:0@lo:38:kworker.0 00000100:00100000:2.0:1788846053.286805:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846053.286846:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3ac7e2af-29a9-4384-8c8c-a41d76049816:3307:1875740739061248:0@lo:400:kworker.0 00000100:00100000:0.0:1788846053.287840:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739061376 00000100:00100000:0.0:1788846053.287847:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739061376 00000100:00100000:0.0:1788846053.287919:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788846053.287927:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b05929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875740739061376:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788846053.287949:0:14412:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:0.0:1788846053.287983:0:14412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1345bc80c7740016 00000004:00100000:0.0:1788846053.287999:0:14412:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788846053.288137:0:14412:0:(import.c:65:import_set_state_nolock()) ffff9a0c0744a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788846053.288232:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b05929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875740739061376:12345-0@lo:38:kworker.0 Request processed in 304us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846053.288239:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788846053.288498:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a0b05929180 x1875740739061376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788846053.288515:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788846053.288522:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788846053.288527:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788846053.288529:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c18542800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788846053.288535:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875740739061376:0@lo:38:kworker.0 00010000:00010000:3.0:1788846053.862512:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846054.889532:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788846055.518332:0:14842:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff376e0f70 20000000:00000080:3.0:1788846055.518350:0:14842:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a0c3e0b1c00 uarg=0000000000000000 20000000:01000000:3.0:1788846055.518382:0:14842:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788846055.518390:0:14842:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788846055.518395:0:14842:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788846055.519017:0:14843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788846055.519265:0:14842:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788846055.523839:0:14842:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788846055.523868:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846055.523887:0:14842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ffde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c773ffd7 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846055.523896:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846055.523941:0:14842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ffde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c773ffd7 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846055.523956:0:14842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ffde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c773ffd7 expref: 11 pid: 14403 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846055.523971:0:14842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14842:1875740739061504:0@lo:104: 00000100:00100000:2.0:1788846055.524044:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846055.524099:0:14842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846055.524200:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739061504 00000100:00100000:3.0:1788846055.524208:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739061504 00000100:00100000:3.0:1788846055.524252:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788846055.524261:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b05928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+3:14842:x1875740739061504:12345-0@lo:104: 00010000:00010000:3.0:1788846055.524273:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ffde expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.524341:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788846055.524347:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b05928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+3:14842:x1875740739061504:12345-0@lo:104: Request processed in 88us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846055.524354:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788846055.524375:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846055.524380:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c773ffde expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.524387:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c9a00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:3.0:1788846055.524390:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c773ffde expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.524398:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c773ffde expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846055.524404:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c773ffde expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846055.524409:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788846055.524436:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ffde expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.524443:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846055.524461:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ffde expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.524468:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9a00/0x1345bc80c773ffd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c773ffde expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.524495:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846055.524497:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846055.524498:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846055.524527:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ac7e2af-29a9-4384-8c8c-a41d76049816:3309:1875740739061632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846055.524555:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846055.524589:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739061632 00000100:00100000:3.0:1788846055.524593:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739061632 00010000:00010000:3.0:1788846055.524621:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ffde lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ffd7 expref: 12 pid: 14403 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846055.524651:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788846055.524658:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:3309:x1875740739061632:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846055.524881:0:14842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14842:1875740739061504:0@lo:104: 00010000:00010000:2.0:1788846055.524899:0:14842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.525240:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846055.525246:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ffde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c773ffd7 expref: 12 pid: 14403 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.525256:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ffde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c773ffd7 expref: 12 pid: 14403 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.525269:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01475800/0x1345bc80c773ffde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c773ffd7 expref: 12 pid: 14403 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.525281:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.525288:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.525300:0:14395:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.525313:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.525319:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.525324:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.525329:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c9e00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846055.525333:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.525340:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.525361:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846055.525370:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846055.525405:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:3309:x1875740739061632:12345-0@lo:103:ldlm_bl.0 Request processed in 747us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846055.525413:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788846055.525447:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ac7e2af-29a9-4384-8c8c-a41d76049816:3309:1875740739061632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788846055.526525:0:14842:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846055.526538:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846055.526544:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c013c9e00/0x1345bc80c774001d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846055.911459:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788846056.870279:0:14407:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788846056.870285:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c3d38b000 from 10 10000000:01000000:3.0:1788846056.870291:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788846056.870335:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846056.870362:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846056.870373:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846056.870398:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739061760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788846056.870471:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846056.870535:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c21b0fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846056.874431:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739061760 00000100:00100000:2.0:1788846056.874446:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739061760 00000100:00100000:2.0:1788846056.874518:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788846056.874528:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+11:14407:x1875740739061760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846056.874543:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846056.874576:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c013c9a00/0x1345bc80c774002b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c7740024 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846056.874614:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c013c9a00/0x1345bc80c774002b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c7740024 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846056.874626:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c013c9a00/0x1345bc80c774002b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c7740024 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846056.874635:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c013c9a00, rc 0) 00000100:00100000:2.0:1788846056.874711:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14407:x1875740739061760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (4240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846056.874718:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788846056.874830:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739061760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846056.876043:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774002b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846056.876057:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c774002b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846056.876129:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739061888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846056.876190:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846056.879663:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739061888 00000100:00100000:0.0:1788846056.879692:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739061888 00000100:00100000:0.0:1788846056.880214:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788846056.880226:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14407:x1875740739061888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788846056.880498:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14407:x1875740739061888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (4308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846056.880668:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788846056.882299:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c21b0fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846056.882332:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739061888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846056.882382:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739062016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788846056.882441:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846056.883344:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c21b0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846056.886081:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739062016 00000100:00100000:0.0:1788846056.886094:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739062016 00000100:00100000:0.0:1788846056.886258:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788846056.886270:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14407:x1875740739062016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788846056.886520:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:14407:x1875740739062016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (4078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846056.886528:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788846056.886896:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739062016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788846056.888284:0:14905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788846056.888464:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788846056.888482:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788846056.888493:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774002b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846056.888515:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774002b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846056.935173:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846057.383241:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846047/real 1788846047] req@ffff9a0c3d673480 x1875740739058688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846057.383268:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a0c3d673480 x1875740739058688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846057.383277:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846047/real 1788846047] req@ffff9a0c3d675f80 x1875740739058560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846057 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846057.383288:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a0c3d675f80 x1875740739058560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846057 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788846057.383304:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c3eb16800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788846057.383324:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788846057.383329:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739058688:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788846057.383334:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c074be800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788846057.383339:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788846057.383342:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739058560:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788846057.385245:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846057.385255:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788846057.385258:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a0c074be800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846057.385265:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 380 00000100:00080000:2.0:1788846057.385271:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788846057.385277:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a0c074be800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1788846057.385309:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0b0592bb80 x1875740739062144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788846057.385330:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846057.385333:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788846057.385335:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a0c3eb16800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846057.385338:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 380 00000100:00080000:2.0:1788846057.385341:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788846057.385344:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a0c3eb16800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1788846057.385366:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0b05929880 x1875740739062272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846057.385400:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788846057.385412:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739062400:0@lo:400:kworker.0 00000100:00100000:2.0:1788846057.385468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846057.385671:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739062144:0@lo:8:kworker.0 00000400:00000100:2.0:1788846057.385696:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740739062144 offset 0 length 520: 4 00000100:00100000:2.0:1788846057.385717:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739062272:0@lo:8:kworker.0 00000400:00000100:2.0:1788846057.385736:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740739062272 offset 0 length 520: 4 00000100:00100000:1.0:1788846057.386380:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739062400 00000100:00100000:1.0:1788846057.386390:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739062400 00000100:00100000:1.0:1788846057.386435:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788846057.386444:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0592b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739062400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846057.387616:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0592b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739062400:12345-0@lo:400:kworker.0 Request processed in 1166us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846057.387628:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788846057.387688:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a0b0592b800 x1875740739062400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846057.387701:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739062400:0@lo:400:kworker.0 00010000:00010000:1.0:1788846057.959347:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846058.982807:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846060.006485:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788846060.184849:0:15092:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788846060.184853:0:15092:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788846060.185046:0:15092:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a0c34df6800 00000020:01000004:3.0:1788846060.185061:0:15092:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788846060.185072:0:15092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788846060.185085:0:15092:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a0c3517b370) 00000020:00000080:3.0:1788846060.185100:0:15092:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788846060.199966:0:15092:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788846060.200272:0:15092:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788846060.201044:0:15092:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788846060.201293:0:15092:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788846060.201762:0:15092:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788846060.202087:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 523: rc = 0 00100000:10000000:2.0:1788846060.202265:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 523: rc = 0 00100000:10000000:2.0:1788846060.202357:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 523: rc = 0 00100000:10000000:2.0:1788846060.202823:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 215: rc = 0 00100000:10000000:2.0:1788846060.203134:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 215: rc = 0 00100000:10000000:2.0:1788846060.203381:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 215: rc = 0 00100000:10000000:2.0:1788846060.203904:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 215: rc = 0 00100000:10000000:2.0:1788846060.204146:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 215: rc = 0 00100000:10000000:2.0:1788846060.204538:0:15092:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 215: rc = 0 00000020:00000080:2.0:1788846060.205719:0:15092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788846060.205735:0:15092:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788846060.205746:0:15092:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1345bc80c7740039 00000020:01000004:2.0:1788846060.205753:0:15092:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788846060.205773:0:15092:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788846060.205776:0:15092:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788846060.205782:0:15092:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788846060.205786:0:15092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788846060.205797:0:15092:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a0b06a24d28) 00000020:00000080:2.0:1788846060.205808:0:15092:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788846060.209354:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788846060.209677:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788846060.209684:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788846060.211132:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788846060.211142:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788846060.218322:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788846060.218333:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788846060.220038:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788846060.220393:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788846060.220399:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788846060.223728:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788846060.223740:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788846060.250255:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846060.252471:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788846060.252477:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788846060.253832:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788846060.253842:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788846060.254847:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788846060.254855:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788846060.256939:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846060.257116:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788846060.257121:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788846060.260770:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788846060.260780:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000040:00080000:2.0:1788846060.264775:0:14442:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788846060.264783:0:14442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788846060.265280:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788846060.265336:0:14442:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788846060.265367:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:3.0:1788846060.287834:0:15092:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788846060.288033:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788846060.288038:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788846060.289257:0:15092:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788846060.289267:0:15092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788846060.290088:0:15092:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788846060.290110:0:15092:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788846060.290115:0:15092:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788846060.306824:0:15092:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788846060.306858:0:15092:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788846060.306865:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788846060.306866:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788846060.306868:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846060.306869:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846060.306870:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846060.306871:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846060.306873:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788846060.306875:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846060.306876:0:15092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788846060.306879:0:15092:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788846060.306881:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788846060.306882:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788846060.306883:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846060.306885:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846060.306886:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846060.306887:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846060.306888:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788846060.306889:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846060.306890:0:15092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788846060.306913:0:15092:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788846060.306932:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739062528:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788846060.306999:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846060.307110:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1167bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846060.307392:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739062528 00000100:00100000:0.0:1788846060.307400:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739062528 00000100:00100000:0.0:1788846060.307475:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788846060.307485:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:15092:x1875740739062528:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788846060.307522:0:14404:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788846060.307525:0:14404:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788846060.307543:0:14404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788846060.345465:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:15092:x1875740739062528:12345-0@lo:253:mount.lustre.0 Request processed in 37974us (38458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846060.345478:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788846060.345595:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739062528:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788846060.345669:0:15092:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788846060.345673:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788846060.345675:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788846060.345676:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846060.345677:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846060.345678:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846060.345680:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846060.345681:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788846060.345683:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846060.345684:0:15092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788846060.345705:0:15092:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a0c34df6800 from lustre-OST0000 10000000:01000000:2.0:1788846060.345729:0:15092:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788846060.345732:0:15092:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788846060.345749:0:15092:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a0c347a4d28 local copy 00010000:00010000:2.0:1788846060.345759:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773ff2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff36 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846060.345967:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739062656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846060.346010:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846060.346045:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1167b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788846060.346105:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739062656 00000100:00100000:0.0:1788846060.346111:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739062656 00000100:00100000:0.0:1788846060.346175:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788846060.346183:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:15092:x1875740739062656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846060.346321:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:15092:x1875740739062656:12345-0@lo:501:mount.lustre.0 Request processed in 138us (310us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788846060.346329:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788846060.346550:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739062656:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788846060.346566:0:15092:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788846060.346795:0:15092:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788846060.346802:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773ff2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff36 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.346811:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773ff2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff36 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846060.346831:0:15092:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a0c34df6800 10000000:01000000:3.0:1788846060.346836:0:15092:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788846060.346840:0:15092:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a0c347a4d28 10000000:01000000:3.0:1788846060.346843:0:15092:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788846060.346846:0:15092:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a0c347a4d28 from 1 10000000:01000000:3.0:1788846060.346849:0:15092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788846060.346872:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475800/0x1345bc80c7740047 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.346880:0:15092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c01475800/0x1345bc80c7740047 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.346889:0:15092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c01475800/0x1345bc80c7740047 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846060.346902:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739062784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846060.346929:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846060.346968:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06b98d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788846060.347025:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739062784 00000100:00100000:0.0:1788846060.347029:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739062784 00000100:00100000:0.0:1788846060.347061:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788846060.347069:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+12:15092:x1875740739062784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846060.347078:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846060.347091:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c3ebcfe00/0x1345bc80c774004e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c7740047 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846060.347111:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3ebcfe00/0x1345bc80c774004e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c7740047 expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846060.347132:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c3ebcfe00/0x1345bc80c774004e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c7740047 expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846060.347141:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcfe00, rc 0) 00000100:00100000:0.0:1788846060.347195:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+13:15092:x1875740739062784:12345-0@lo:101:mount.lustre.0 Request processed in 127us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846060.347202:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788846060.347345:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739062784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846060.347356:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c01475800/0x1345bc80c7740047 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774004e expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.347365:0:15092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c01475800/0x1345bc80c7740047 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c774004e expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846060.347380:0:15092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788846060.347396:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475800/0x1345bc80c7740047 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774004e expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.347404:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c01475800/0x1345bc80c7740047 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774004e expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846060.347410:0:15092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788846060.347413:0:15092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788846060.347417:0:15092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788846060.347419:0:15092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788846060.347431:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01474c00/0x1345bc80c7740055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.347438:0:15092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c01474c00/0x1345bc80c7740055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.347445:0:15092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c01474c00/0x1345bc80c7740055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846060.347456:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739062912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846060.347479:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846060.347511:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06b98d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788846060.347818:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739062912 00000100:00100000:0.0:1788846060.347824:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739062912 00000100:00100000:0.0:1788846060.347857:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788846060.347871:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+13:15092:x1875740739062912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846060.347879:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846060.347886:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c3ebcee00/0x1345bc80c774005c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c7740055 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846060.347901:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3ebcee00/0x1345bc80c774005c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c7740055 expref: 14 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846060.347910:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c3ebcee00/0x1345bc80c774005c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c7740055 expref: 14 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846060.347916:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebcee00, rc 0) 00000100:00100000:0.0:1788846060.347951:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+14:15092:x1875740739062912:12345-0@lo:101:mount.lustre.0 Request processed in 81us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846060.347957:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788846060.348024:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739062912:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846060.348035:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c01474c00/0x1345bc80c7740055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774005c expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846060.348043:0:15092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c01474c00/0x1345bc80c7740055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c774005c expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846060.348680:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788846060.349409:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788846060.349661:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788846060.349703:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788846060.349736:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788846060.349784:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788846060.349817:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788846060.349860:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788846060.349918:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788846060.349925:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788846060.349992:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846060.350042:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846060.350073:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1167b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788846060.350376:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739063040 00000100:00100000:0.0:1788846060.350383:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739063040 00000100:00100000:0.0:1788846060.350423:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788846060.350433:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+14:15092:x1875740739063040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846060.350857:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+14:15092:x1875740739063040:12345-0@lo:501:mount.lustre.0 Request processed in 425us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846060.350866:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788846060.350994:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846060.351027:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846060.351069:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846060.351087:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c1167b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788846060.351150:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739063168 00000100:00100000:3.0:1788846060.351175:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739063168 00000100:00100000:3.0:1788846060.351203:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788846060.351210:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0431b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+14:15092:x1875740739063168:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846060.351467:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0431b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+14:15092:x1875740739063168:12345-0@lo:503:mount.lustre.0 Request processed in 257us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846060.351474:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788846060.351794:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063168:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788846060.352492:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788846060.352794:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846060.352849:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846060.352885:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06b983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846060.352938:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739063296 00000100:00100000:2.0:1788846060.352944:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739063296 00000100:00100000:2.0:1788846060.352983:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788846060.352991:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+14:15092:x1875740739063296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846060.353321:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+14:15092:x1875740739063296:12345-0@lo:502:mount.lustre.0 Request processed in 329us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846060.353329:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788846060.353406:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846060.353784:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788846060.353833:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788846060.353868:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788846060.353939:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788846060.354000:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788846060.354034:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788846060.354075:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788846060.354107:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788846060.354425:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788846060.354482:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788846060.354521:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788846060.354707:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788846060.354746:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846060.354803:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846060.354986:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06b983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846060.355087:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739063424 00000100:00100000:2.0:1788846060.355094:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739063424 00000100:00100000:2.0:1788846060.355136:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788846060.355145:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0431a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+14:15092:x1875740739063424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846060.355324:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0431a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+14:15092:x1875740739063424:12345-0@lo:502:mount.lustre.0 Request processed in 179us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846060.355331:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788846060.355515:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846060.355718:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788846060.355729:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788846060.356742:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788846060.356751:0:15106:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788846060.356757:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846060.356760:0:15106:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788846060.356765:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788846060.356781:0:15106:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a0b06a23370) 00000020:00000080:2.0:1788846060.356800:0:15106:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788846060.356806:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788846060.356875:0:15106:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a0c34df6800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788846060.356883:0:15106:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788846060.356889:0:15106:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1345bc80c774006a 00010000:00010000:3.0:1788846060.366924:0:15106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788846060.367649:0:15106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788846060.370596:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788846060.372669:0:15106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788846060.372679:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846060.372685:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846060.372687:0:15106:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788846060.372690:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788846060.372693:0:15106:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788846060.372695:0:15106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788846060.372709:0:15106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788846060.372710:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788846060.372713:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846060.372714:0:15106:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788846060.372717:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846060.372720:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846060.372721:0:15106:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788846060.372724:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788846060.372726:0:15106:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788846060.372728:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846060.372730:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846060.372732:0:15106:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788846060.372734:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846060.372736:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846060.372737:0:15106:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788846060.372740:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788846060.372797:0:15106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846060.372801:0:15106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846060.372803:0:15106:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788846060.372806:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788846060.375507:0:15092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788846060.375556:0:15092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788846060.375590:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01474c00/0x1345bc80c7740055 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774005c expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846060.375603:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c01474c00/0x1345bc80c7740055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774005c expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846060.375611:0:15092:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c34df6800 from 1 10000000:01000000:2.0:1788846060.375614:0:15092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788846060.375649:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846060.375658:0:15092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846060.375669:0:15092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846060.375691:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846060.375751:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846060.375793:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b067316c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846060.375950:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739063552 00000100:00100000:3.0:1788846060.375957:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739063552 00000100:00100000:3.0:1788846060.376001:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788846060.376484:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+14:15092:x1875740739063552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846060.376497:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846060.376511:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01474000/0x1345bc80c7740078 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c7740071 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.376544:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01474000/0x1345bc80c7740078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c7740071 expref: 15 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.376556:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01474000/0x1345bc80c7740078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c7740071 expref: 15 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.376564:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474000, rc 0) 00000100:00100000:3.0:1788846060.376776:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+15:15092:x1875740739063552:12345-0@lo:101:mount.lustre.0 Request processed in 296us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846060.376784:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788846060.382827:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846060.382854:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c7740078 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846060.382867:0:15092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c7740078 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788846060.383393:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788846060.383790:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788846060.384014:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788846060.384053:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788846060.384102:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788846060.384109:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788846060.384197:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d674a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846060.384252:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846060.384288:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846060.384606:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739063680 00000100:00100000:0.0:1788846060.384613:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739063680 00000100:00100000:0.0:1788846060.384657:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788846060.384667:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0431b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+15:15092:x1875740739063680:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846060.384861:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0431b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+15:15092:x1875740739063680:12345-0@lo:501:mount.lustre.0 Request processed in 195us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846060.384870:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788846060.385039:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d674a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846060.385071:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d674a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063808:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788846060.385106:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846060.385265:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846060.389805:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739063808 00000100:00100000:2.0:1788846060.389818:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739063808 00000100:00100000:2.0:1788846060.389883:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788846060.389894:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+15:15092:x1875740739063808:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846060.390237:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+15:15092:x1875740739063808:12345-0@lo:503:mount.lustre.0 Request processed in 344us (5128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846060.390245:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788846060.390434:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d674a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063808:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788846060.391270:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788846060.391338:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d674a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846060.391390:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846060.391417:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846060.392944:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739063936 00000100:00100000:2.0:1788846060.392959:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739063936 00000100:00100000:2.0:1788846060.393963:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788846060.393976:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0431a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+15:15092:x1875740739063936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846060.394379:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0431a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+15:15092:x1875740739063936:12345-0@lo:502:mount.lustre.0 Request processed in 407us (2987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846060.394388:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788846060.396242:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d674a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739063936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788846060.396539:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788846060.396614:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788846060.396665:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788846060.396699:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788846060.396741:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788846060.396788:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788846060.396824:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788846060.396875:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788846060.396915:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739064064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846060.397657:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846060.397691:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788846060.397799:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739064064 00000100:00100000:1.0:1788846060.397806:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739064064 00000100:00100000:1.0:1788846060.397853:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788846060.397861:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0431ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+15:15092:x1875740739064064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846060.398093:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0431ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+15:15092:x1875740739064064:12345-0@lo:502:mount.lustre.0 Request processed in 232us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846060.398102:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788846060.398364:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739064064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846060.398471:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788846060.398482:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788846060.399715:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846060.399732:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846060.399741:0:15110:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788846060.399750:0:15110:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a0c34df6800 00000020:00000080:3.0:1788846060.399752:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788846060.399760:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846060.399762:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846060.399764:0:15110:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788846060.399766:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846060.399769:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846060.399770:0:15110:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788846060.399772:0:15110:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a0c34df6800 00000020:00000080:3.0:1788846060.399775:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788846060.399834:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846060.399838:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846060.399840:0:15110:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788846060.399843:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846060.399846:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846060.399847:0:15110:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788846060.399851:0:15110:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a0c34df6800 00000020:00000080:3.0:1788846060.399853:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788846060.399887:0:15110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846060.399890:0:15110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846060.399892:0:15110:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788846060.399895:0:15110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788846060.401921:0:15092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788846060.401957:0:15092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788846060.401982:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c7740078 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846060.401995:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c7740078 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846060.402054:0:15092:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788846060.402057:0:15092:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a0c34df6800 10000000:01000000:2.0:1788846060.402060:0:15092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a0c34df6800 10000000:01000000:2.0:1788846060.402064:0:15092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788846060.402069:0:15092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a0c34df6800 from 1 10000000:01000000:2.0:1788846060.402072:0:15092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788846060.402108:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9e00/0x1345bc80c774007f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846060.402128:0:15092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9e00/0x1345bc80c774007f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846060.402139:0:15092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9e00/0x1345bc80c774007f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846060.402201:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05928000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739064192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846060.402265:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846060.402304:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739064192 00000100:00100000:2.0:1788846060.402310:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739064192 00000100:00100000:2.0:1788846060.402350:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788846060.402359:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+15:15092:x1875740739064192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846060.402372:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846060.402396:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0b04375800/0x1345bc80c7740086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c774007f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846060.402419:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0b04375800/0x1345bc80c7740086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c774007f expref: 16 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846060.402430:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0b04375800/0x1345bc80c7740086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c774007f expref: 16 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846060.402439:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04375800, rc 0) 00000100:00100000:2.0:1788846060.402470:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15092:x1875740739064192:12345-0@lo:101:mount.lustre.0 Request processed in 113us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846060.402477:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788846060.402515:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846060.402534:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05928000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739064192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846060.402546:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9e00/0x1345bc80c774007f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c7740086 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846060.402555:0:15092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9e00/0x1345bc80c774007f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c7740086 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846060.404971:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788846060.405360:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788846060.405825:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788846060.405870:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788846060.405921:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788846060.405988:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788846060.406028:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788846060.406077:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788846060.406112:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788846060.406146:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788846060.406218:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788846060.406255:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788846060.406287:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788846060.406332:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788846060.406366:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788846060.406400:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788846060.406447:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788846060.406484:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788846060.406519:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788846060.406919:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788846060.407408:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788846060.407447:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788846060.407498:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788846060.407533:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788846060.407589:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788846060.407640:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788846060.407678:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788846060.407712:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788846060.407890:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788846060.407930:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788846060.408011:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788846060.408026:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788846060.408121:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05928000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739064320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846060.408202:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846060.408246:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846060.408330:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739064320 00000100:00100000:0.0:1788846060.408337:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739064320 00000100:00100000:0.0:1788846060.408375:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788846060.408383:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d429c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15092:x1875740739064320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846060.408596:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d429c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15092:x1875740739064320:12345-0@lo:501:mount.lustre.0 Request processed in 212us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846060.408603:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788846060.408665:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05928000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739064320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846060.408697:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05928000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739064448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846060.408733:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846060.408766:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846060.409278:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739064448 00000100:00100000:2.0:1788846060.409283:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739064448 00000100:00100000:2.0:1788846060.409311:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788846060.409318:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15092:x1875740739064448:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846060.409456:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15092:x1875740739064448:12345-0@lo:503:mount.lustre.0 Request processed in 137us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846060.409462:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788846060.409507:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05928000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739064448:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788846060.410110:0:15092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788846060.410188:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05928000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739064576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846060.410229:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846060.410261:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846060.411295:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739064576 00000100:00100000:0.0:1788846060.411303:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739064576 00000100:00100000:0.0:1788846060.411344:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788846060.411352:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15092:x1875740739064576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846060.411561:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15092:x1875740739064576:12345-0@lo:502:mount.lustre.0 Request processed in 209us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846060.411578:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788846060.412016:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05928000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739064576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846060.412307:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788846060.412359:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788846060.412406:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788846060.412452:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788846060.412497:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788846060.412543:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788846060.413927:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788846060.413975:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788846060.414037:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788846060.414071:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788846060.414099:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788846060.414142:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788846060.414193:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788846060.414225:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788846060.414272:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788846060.414307:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788846060.414339:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788846060.414381:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788846060.414435:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788846060.414470:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788846060.414530:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788846060.415039:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788846060.415083:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788846060.415135:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788846060.415195:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788846060.415229:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788846060.415272:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788846060.415308:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788846060.415340:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788846060.415378:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788846060.415408:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788846060.415436:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788846060.415466:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788846060.415527:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788846060.415663:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788846060.415718:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788846060.415933:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788846060.415981:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788846060.416031:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788846060.416068:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788846060.416115:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05928000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739064704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846060.416207:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846060.416252:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788846060.416411:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739064704 00000100:00100000:3.0:1788846060.416418:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739064704 00000100:00100000:3.0:1788846060.416459:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788846060.416467:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d428050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15092:x1875740739064704:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846060.416681:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d428050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15092:x1875740739064704:12345-0@lo:502:mount.lustre.0 Request processed in 214us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846060.416689:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788846060.416853:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05928000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739064704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846060.416920:0:15092:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788846060.416930:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788846060.420665:0:15113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788846060.420681:0:15113:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a0c35178000) 00000020:00000080:3.0:1788846060.420708:0:15113:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788846060.420859:0:15113:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a0c34df6800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788846060.420864:0:15113:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a0c34df6800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788846060.420866:0:15113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a0c34df6800 3 00010000:00080000:3.0:1788846060.420895:0:15113:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a0c352fa000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1788846060.427335:0:15113:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788846060.428414:0:15113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788846060.428452:0:15113:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788846060.428464:0:15113:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1345bc80c7740094 00000100:00080000:1.0:1788846060.428474:0:15113:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788846060.428479:0:15113:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a0c352fa000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1788846060.428512:0:15113:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3d674a80 x1875740739064832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846060.428539:0:15113:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788846060.428706:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875740739064832:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846060.428773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788846060.429336:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846060.429341:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788846060.429343:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846060.429346:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788846060.429461:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739064960:0@lo:400:kworker.0 00000100:00100000:1.0:1788846060.429461:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739064832 00000100:00100000:1.0:1788846060.429467:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739064832 00000100:00100000:3.0:1788846060.429491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846060.429493:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788846060.429499:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b05928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875740739064832:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788846060.429520:0:14412:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 392 last 0 00000100:00100000:3.0:1788846060.429528:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788846060.429534:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:00000080:1.0:1788846060.429553:0:14412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1345bc80c774009b 00000004:00100000:1.0:1788846060.429567:0:14412:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788846060.429605:0:14412:0:(import.c:65:import_set_state_nolock()) ffff9a0c3c968800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846060.429660:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b05928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875740739064832:12345-0@lo:38:llog_process_th.0 Request processed in 159us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846060.429667:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788846060.429681:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739064960 00010000:00080000:2.0:1788846060.429734:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a0c3d674a80 x1875740739064832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846060.429744:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846060.429751:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788846060.429758:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788846060.429762:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788846060.429764:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c352fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788846060.429769:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875740739064832:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788846060.430648:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739064960 00000100:00100000:1.0:1788846060.430682:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788846060.430689:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739064960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846060.430738:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739064960:12345-0@lo:400:kworker.0 Request processed in 50us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846060.430745:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788846060.435545:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a0c3d529880 x1875740739064960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846060.435649:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739064960:0@lo:400:kworker.0 00000040:00080000:0.0:1788846060.436168:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788846060.436515:0:15092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788846060.436550:0:15092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788846060.436611:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9e00/0x1345bc80c774007f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c7740086 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846060.436624:0:15092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9e00/0x1345bc80c774007f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c7740086 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788846060.436677:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788846060.436679:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788846060.436680:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846060.436682:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846060.436683:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846060.436684:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846060.436685:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788846060.436687:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846060.436688:0:15092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788846060.436692:0:15092:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788846060.436695:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788846060.436696:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788846060.436697:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846060.436698:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846060.436699:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846060.436700:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846060.436701:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788846060.436703:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846060.436703:0:15092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788846060.436730:0:15092:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788846060.436746:0:15092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05928700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739065088:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788846060.436811:0:15092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846060.436843:0:15092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06731780 going to sleep for 11 seconds 00000100:00100000:2.0:1788846060.436865:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739065088 00000100:00100000:2.0:1788846060.436873:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739065088 00000100:00100000:2.0:1788846060.436913:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788846060.436923:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d429050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15092:x1875740739065088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788846060.436969:0:14405:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788846060.436983:0:14405:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788846060.466260:0:14405:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788846060.466275:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788846060.467149:0:14426:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788846060.467530:0:14426:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788846060.467552:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846060.467579:0:14426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c013c8200/0x1345bc80c774000f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c7740008 expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846060.467603:0:14426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846060.467641:0:14426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c013c8200/0x1345bc80c774000f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c7740008 expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846060.467655:0:14426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c013c8200/0x1345bc80c774000f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c7740008 expref: 16 pid: 14403 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846060.467670:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d672d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14426:1875740739065216:0@lo:104: 00000100:00100000:0.0:1788846060.467729:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846060.467951:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739065216 00000100:00100000:3.0:1788846060.467958:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739065216 00000100:00100000:3.0:1788846060.468003:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788846060.468012:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+3:14426:x1875740739065216:12345-0@lo:104: 00010000:00010000:3.0:1788846060.468024:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c774000f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.468613:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788846060.468628:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d672a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+3:14426:x1875740739065216:12345-0@lo:104: Request processed in 617us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846060.468637:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788846060.468657:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846060.468662:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c774000f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.468671:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcec00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:3.0:1788846060.468675:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c774000f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.468685:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c774000f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846060.468693:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c774000f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846060.468699:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788846060.468728:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c774000f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.468734:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846060.468763:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c774000f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.468770:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcec00/0x1345bc80c7740008 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c774000f expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.468784:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846060.468786:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846060.468788:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846060.468805:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3ac7e2af-29a9-4384-8c8c-a41d76049816:3308:1875740739065344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846060.468835:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846060.468880:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739065344 00000100:00100000:3.0:1788846060.468885:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739065344 00010000:00010000:3.0:1788846060.468901:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c013c8200/0x1345bc80c774000f lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c7740008 expref: 17 pid: 14403 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846060.468921:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788846060.468927:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:3308:x1875740739065344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846060.468937:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846060.468941:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c013c8200/0x1345bc80c774000f lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c7740008 expref: 17 pid: 14403 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.468951:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c013c8200/0x1345bc80c774000f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c7740008 expref: 17 pid: 14403 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.468967:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.468975:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788846060.468988:0:14397:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001458645s 00010000:00010000:3.0:1788846060.468992:0:14397:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.468999:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.469005:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.469021:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.469027:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846060.469031:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.469039:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.469048:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846060.469056:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846060.469085:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:3308:x1875740739065344:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846060.469093:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788846060.469142:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3ac7e2af-29a9-4384-8c8c-a41d76049816:3308:1875740739065344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788846060.471914:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0b06eb9f00 going to sleep for 11 seconds 00010000:00010000:0.0:1788846060.471950:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c013c8200/0x1345bc80c774000f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c7740008 expref: 16 pid: 14403 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846060.471968:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d672d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14426:1875740739065216:0@lo:104: 00010000:00010000:0.0:1788846060.471993:0:14426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846060.472003:0:14426:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846060.472010:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846060.472017:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c3ebce600/0x1345bc80c77400a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846060.472372:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d429050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+15:15092:x1875740739065088:12345-0@lo:253:mount.lustre.0 Request processed in 35448us (35559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846060.472382:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788846060.472458:0:15092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05928700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15092:1875740739065088:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788846060.472470:0:15092:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788846060.472473:0:15092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788846060.472484:0:15092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788846060.472486:0:15092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846060.472487:0:15092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846060.472488:0:15092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846060.472489:0:15092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846060.472491:0:15092:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788846060.472493:0:15092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846060.472494:0:15092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788846060.472507:0:15092:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788846060.476685:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788846060.476950:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788846060.477108:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788846060.477474:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788846060.477634:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788846060.477865:0:15092:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788846060.478676:0:15092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788846060.526986:0:15092:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788846060.526993:0:15092:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788846060.527026:0:15092:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788846060.527075:0:15092:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788846060.527089:0:15092:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788846060.527268:0:15092:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788846061.033011:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846062.054369:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788846062.447927:0:14407:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788846062.447941:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a0c3d38b000 from 7 10000000:01000000:0.0:1788846062.447946:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788846062.447990:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846062.448002:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846062.448014:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846062.448040:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d672d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739065472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788846062.448102:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846062.448407:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846062.456262:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739065472 00000100:00100000:2.0:1788846062.456275:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739065472 00000100:00100000:2.0:1788846062.456369:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788846062.456378:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+15:14407:x1875740739065472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846062.456392:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846062.456411:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0b04375600/0x1345bc80c77400b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c77400a9 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846062.456438:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0b04375600/0x1345bc80c77400b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c77400a9 expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846062.456465:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0b04375600/0x1345bc80c77400b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c77400a9 expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846062.456473:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04375600, rc 0) 00000100:00100000:2.0:1788846062.456581:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:14407:x1875740739065472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (8479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846062.456589:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788846062.458816:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d672d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739065472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846062.458843:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77400b0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846062.458856:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c77400b0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846062.458935:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739065600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788846062.459008:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846062.459345:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788846062.459469:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739065600 00000100:00100000:0.0:1788846062.459477:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739065600 00000100:00100000:0.0:1788846062.459518:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788846062.459527:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:14407:x1875740739065600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788846062.459546:0:14404:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788846062.459572:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788846062.459575:0:14404:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788846062.459669:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:14407:x1875740739065600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846062.459677:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788846062.459814:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739065600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788846062.459868:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788846062.459876:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77400b0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846062.459885:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77400b0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846063.078753:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846064.102768:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846065.127448:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788846065.577565:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846065.577572:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788846065.577575:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846065.577578:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788846065.577628:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739065984:0@lo:400:kworker.0 00000100:00100000:3.0:1788846065.577694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846065.578682:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ac7e2af-29a9-4384-8c8c-a41d76049816:3309:1875740739065728:0@lo:400:kworker.0 00000100:00100000:1.0:1788846065.578899:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846065.579002:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788846065.579009:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739065856:0@lo:400:kworker.0 00000100:00100000:1.0:1788846065.579036:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846065.579072:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739065984 00000100:00100000:1.0:1788846065.579079:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739065984 00000100:00100000:1.0:1788846065.579131:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739065856 00000100:00100000:1.0:1788846065.579135:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739065856 00000100:00100000:0.0:1788846065.579244:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739065728 00000100:00100000:0.0:1788846065.579249:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739065728 00000100:00100000:0.0:1788846065.579277:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788846065.579284:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d428850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:3309:x1875740739065728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846065.579332:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d428850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:3309:x1875740739065728:12345-0@lo:400:kworker.0 Request processed in 48us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846065.579348:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788846065.579381:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788846065.579388:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739065984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846065.579426:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739065984:12345-0@lo:400:kworker.0 Request processed in 38us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846065.579432:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788846065.579445:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788846065.579451:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739065856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846065.579478:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739065856:12345-0@lo:400:kworker.0 Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846065.579484:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788846065.579524:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d529c00 x1875740739065984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846065.579538:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739065984:0@lo:400:kworker.0 00000100:00080000:2.0:1788846065.579905:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788846065.580092:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d529500 x1875740739065856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846065.580103:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739065856:0@lo:400:kworker.0 00000100:00100000:1.0:1788846065.580114:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ac7e2af-29a9-4384-8c8c-a41d76049816:3309:1875740739065728:0@lo:400:kworker.0 00000001:02000400:2.0:1788846065.886135:0:15460:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788846066.150305:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846067.174992:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846068.199869:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846069.226376:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846070.246288:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788846070.505269:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1788846070.694689:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846070.694697:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788846070.694701:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846070.694704:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788846070.694756:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3ac7e2af-29a9-4384-8c8c-a41d76049816:3308:1875740739066112:0@lo:400:kworker.0 00000100:00100000:3.0:1788846070.694826:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846070.694893:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739066240:0@lo:400:kworker.0 00000100:00100000:3.0:1788846070.694920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846070.694941:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788846070.694946:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739066368:0@lo:400:kworker.0 00000100:00100000:3.0:1788846070.694967:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846070.694993:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739066112 00000100:00100000:3.0:1788846070.694999:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739066112 00000100:00100000:3.0:1788846070.695052:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788846070.695066:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:3308:x1875740739066112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846070.695126:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:3308:x1875740739066112:12345-0@lo:400:kworker.0 Request processed in 66us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846070.695133:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788846070.695181:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739066240 00000100:00100000:3.0:1788846070.695185:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739066240 00000100:00100000:3.0:1788846070.695208:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739066368 00000100:00100000:3.0:1788846070.695210:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739066368 00000100:00100000:3.0:1788846070.695234:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788846070.695240:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739066240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846070.695687:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739066240:12345-0@lo:400:kworker.0 Request processed in 446us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846070.695694:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788846070.695707:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788846070.695715:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739066368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846070.695872:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739066368:12345-0@lo:400:kworker.0 Request processed in 158us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846070.695879:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788846070.695955:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788846070.695994:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d529500 x1875740739066368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846070.696009:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739066368:0@lo:400:kworker.0 00010000:00080000:3.0:1788846070.696018:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d529880 x1875740739066240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846070.697208:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739066240:0@lo:400:kworker.0 00000100:00100000:3.0:1788846070.697381:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3ac7e2af-29a9-4384-8c8c-a41d76049816:3308:1875740739066112:0@lo:400:kworker.0 00010000:00010000:0.0:1788846071.283234:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788846071.976029:0:15810:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788846071.976034:0:15810:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788846071.976935:0:15810:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a0c3d8b3800 00000020:01000004:2.0:1788846071.976951:0:15810:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788846071.976963:0:15810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788846071.976976:0:15810:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a0b06a219b8) 00000020:00000080:2.0:1788846071.976991:0:15810:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788846071.998999:0:15810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788846071.999425:0:15810:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788846072.000346:0:15810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788846072.000586:0:15810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788846072.000802:0:15810:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788846072.001694:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 439: rc = 0 00100000:10000000:2.0:1788846072.001824:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 439: rc = 0 00100000:10000000:2.0:1788846072.001966:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 439: rc = 0 00100000:10000000:2.0:1788846072.003857:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 99: rc = 0 00100000:10000000:2.0:1788846072.004260:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 99: rc = 0 00100000:10000000:2.0:1788846072.004759:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 99: rc = 0 00100000:10000000:2.0:1788846072.005017:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 99: rc = 0 00100000:10000000:2.0:1788846072.005543:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 99: rc = 0 00100000:10000000:2.0:1788846072.005779:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 99: rc = 0 00000020:00000080:2.0:1788846072.006554:0:15810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788846072.006565:0:15810:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788846072.006575:0:15810:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1345bc80c77400be 00000020:01000004:2.0:1788846072.006582:0:15810:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788846072.006601:0:15810:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788846072.006604:0:15810:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788846072.006610:0:15810:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788846072.006629:0:15810:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788846072.006633:0:15810:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788846072.016302:0:15810:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788846072.016349:0:15810:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.148@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788846072.016354:0:15810:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788846072.016356:0:15810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788846072.016358:0:15810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788846072.016359:0:15810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788846072.016360:0:15810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788846072.016361:0:15810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788846072.016362:0:15810:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788846072.016364:0:15810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788846072.016365:0:15810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788846072.016374:0:15810:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788846072.016377:0:15810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788846072.016378:0:15810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788846072.016379:0:15810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788846072.016380:0:15810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788846072.016381:0:15810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788846072.016382:0:15810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788846072.016383:0:15810:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788846072.016383:0:15810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788846072.016384:0:15810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788846072.016427:0:15810:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788846072.016455:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739066496:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788846072.016541:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846072.016649:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c053ad840 going to sleep for 11 seconds 00000100:00100000:0.0:1788846072.016726:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739066496 00000100:00100000:0.0:1788846072.016733:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739066496 00000100:00100000:0.0:1788846072.016820:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788846072.016830:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15810:x1875740739066496:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788846072.016858:0:14403:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788846072.016861:0:14403:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788846072.016865:0:14403:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788846072.022687:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15810:x1875740739066496:12345-0@lo:253:mount.lustre.0 Request processed in 5850us (6137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846072.022702:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788846072.022827:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739066496:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788846072.022842:0:15810:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788846072.022845:0:15810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788846072.022847:0:15810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788846072.022848:0:15810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846072.022850:0:15810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846072.022851:0:15810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846072.022852:0:15810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846072.022854:0:15810:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788846072.022856:0:15810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846072.022857:0:15810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788846072.022880:0:15810:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a0c3d8b3800 from lustre-OST0001 10000000:01000000:1.0:1788846072.022904:0:15810:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788846072.022907:0:15810:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788846072.022914:0:15810:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a0c347a4d28 local copy 00010000:00010000:1.0:1788846072.022932:0:15810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773ff2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff36 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846072.023188:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739066624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846072.023223:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846072.023571:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c190f3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846072.023650:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739066624 00000100:00100000:3.0:1788846072.023657:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739066624 00000100:00100000:3.0:1788846072.023691:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788846072.023700:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d428c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15810:x1875740739066624:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846072.023868:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d428c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15810:x1875740739066624:12345-0@lo:501:mount.lustre.0 Request processed in 169us (644us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788846072.023875:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788846072.023997:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739066624:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788846072.024011:0:15810:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788846072.024205:0:15810:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788846072.024212:0:15810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773ff2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff36 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846072.024221:0:15810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebcf800/0x1345bc80c773ff2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c773ff36 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846072.024241:0:15810:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a0c3d8b3800 10000000:01000000:1.0:1788846072.024246:0:15810:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788846072.024250:0:15810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788846072.024253:0:15810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788846072.024257:0:15810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788846072.024260:0:15810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788846072.024283:0:15810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c34a00c00/0x1345bc80c77400c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846072.024290:0:15810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c34a00c00/0x1345bc80c77400c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846072.024299:0:15810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c34a00c00/0x1345bc80c77400c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846072.024323:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739066752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788846072.024351:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846072.024368:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c190f3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846072.024518:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739066752 00000100:00100000:3.0:1788846072.024523:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739066752 00000100:00100000:3.0:1788846072.024544:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788846072.024551:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d428450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:15810:x1875740739066752:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846072.024559:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846072.024571:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01474a00/0x1345bc80c77400cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c77400c5 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.024589:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01474a00/0x1345bc80c77400cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c77400c5 expref: 17 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.024610:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01474a00/0x1345bc80c77400cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c77400c5 expref: 17 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.024618:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474a00, rc 0) 00000100:00100000:3.0:1788846072.024646:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d428450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:15810:x1875740739066752:12345-0@lo:101:mount.lustre.0 Request processed in 95us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846072.024652:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788846072.024762:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739066752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846072.024774:0:15810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c34a00c00/0x1345bc80c77400c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77400cc expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846072.024783:0:15810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c34a00c00/0x1345bc80c77400c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c77400cc expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788846072.025359:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788846072.026244:0:15810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788846072.026474:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788846072.026532:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788846072.026568:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788846072.026615:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788846072.026652:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788846072.026685:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788846072.026749:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788846072.026757:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788846072.026825:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739066880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846072.026881:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846072.026914:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c190f3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788846072.028301:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739066880 00000100:00100000:3.0:1788846072.028311:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739066880 00000100:00100000:3.0:1788846072.028352:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788846072.028360:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:15810:x1875740739066880:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846072.028745:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:15810:x1875740739066880:12345-0@lo:501:mount.lustre.0 Request processed in 384us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846072.028753:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788846072.029329:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739066880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846072.029375:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788846072.029423:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846072.029517:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c190f3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788846072.029661:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739067008 00000100:00100000:2.0:1788846072.029667:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739067008 00000100:00100000:3.0:1788846072.029703:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788846072.029712:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d429850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:15810:x1875740739067008:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846072.030412:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d429850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:15810:x1875740739067008:12345-0@lo:503:mount.lustre.0 Request processed in 700us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846072.030421:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788846072.030488:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067008:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788846072.032053:0:15810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788846072.032233:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846072.032298:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846072.032336:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c190f3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788846072.032467:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739067136 00000100:00100000:2.0:1788846072.032483:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739067136 00000100:00100000:2.0:1788846072.032535:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788846072.032681:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d3f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:15810:x1875740739067136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846072.033098:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d3f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:15810:x1875740739067136:12345-0@lo:502:mount.lustre.0 Request processed in 421us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846072.033106:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788846072.033238:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788846072.035459:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788846072.035673:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788846072.035706:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788846072.035752:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788846072.035789:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788846072.035825:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788846072.035874:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788846072.035983:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788846072.036054:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788846072.036099:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067264:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846072.036263:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846072.036305:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c190f3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788846072.036309:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739067264 00000100:00100000:3.0:1788846072.036317:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739067264 00000100:00100000:3.0:1788846072.036369:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788846072.036378:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d3f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:15810:x1875740739067264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846072.036571:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d3f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:15810:x1875740739067264:12345-0@lo:502:mount.lustre.0 Request processed in 194us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846072.036588:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788846072.036718:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067264:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788846072.036785:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788846072.036793:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788846072.040013:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788846072.040024:0:15811:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788846072.040029:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846072.040032:0:15811:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788846072.040037:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788846072.040050:0:15811:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a0c089a4d28) 00000020:00000080:3.0:1788846072.040138:0:15811:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788846072.040144:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788846072.040342:0:15811:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a0c3d8b3800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788846072.040348:0:15811:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788846072.040426:0:15811:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1345bc80c77400da 00010000:00010000:2.0:1788846072.048412:0:15811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788846072.048800:0:15811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788846072.051791:0:15811:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788846072.054124:0:15811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788846072.054136:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846072.054142:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846072.054144:0:15811:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788846072.054148:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846072.054182:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846072.054184:0:15811:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788846072.054188:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788846072.054190:0:15811:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788846072.054193:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846072.054196:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846072.054197:0:15811:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788846072.054200:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846072.054203:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846072.054204:0:15811:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788846072.054207:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788846072.054577:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846072.054582:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846072.054583:0:15811:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788846072.054586:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788846072.054745:0:15810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788846072.054782:0:15810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788846072.054809:0:15810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c34a00c00/0x1345bc80c77400c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77400cc expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846072.054824:0:15810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c34a00c00/0x1345bc80c77400c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77400cc expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846072.054842:0:15810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c3d8b3800 from 1 10000000:01000000:1.0:1788846072.054844:0:15810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788846072.054882:0:15810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846072.054891:0:15810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846072.054903:0:15810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846072.054927:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788846072.054996:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846072.055040:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c190f3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788846072.055199:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739067392 00000100:00100000:3.0:1788846072.055208:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739067392 00000100:00100000:3.0:1788846072.055259:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788846072.055269:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d3f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:15810:x1875740739067392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846072.055283:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846072.055297:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01474800/0x1345bc80c77400e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c77400e1 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.055321:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01474800/0x1345bc80c77400e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c77400e1 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.055332:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01474800/0x1345bc80c77400e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c77400e1 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.055340:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474800, rc 0) 00000100:00100000:3.0:1788846072.055380:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d3f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:15810:x1875740739067392:12345-0@lo:101:mount.lustre.0 Request processed in 112us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846072.055397:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788846072.055503:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846072.055526:0:15810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77400e8 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846072.055536:0:15810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c77400e8 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788846072.056000:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788846072.056368:0:15810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788846072.056643:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788846072.056689:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788846072.056752:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788846072.056760:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788846072.056824:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846072.056879:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846072.056911:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c190f3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788846072.056950:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739067520 00000100:00100000:0.0:1788846072.056957:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739067520 00000100:00100000:0.0:1788846072.056998:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788846072.057008:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d3f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:15810:x1875740739067520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846072.057266:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d3f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:15810:x1875740739067520:12345-0@lo:501:mount.lustre.0 Request processed in 259us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846072.057274:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788846072.057300:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846072.057331:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788846072.057369:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846072.057434:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c190f3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788846072.057491:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739067648 00000100:00100000:3.0:1788846072.057497:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739067648 00000100:00100000:3.0:1788846072.057542:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788846072.057550:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d3f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:15810:x1875740739067648:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846072.057692:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d3f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:15810:x1875740739067648:12345-0@lo:503:mount.lustre.0 Request processed in 142us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846072.057699:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788846072.058222:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067648:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788846072.059844:0:15810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788846072.059932:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846072.060002:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846072.061678:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b30480 going to sleep for 11 seconds 00000100:00100000:1.0:1788846072.063522:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739067776 00000100:00100000:1.0:1788846072.063534:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739067776 00000100:00100000:1.0:1788846072.063591:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788846072.063601:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d3f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:15810:x1875740739067776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846072.063861:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d3f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:15810:x1875740739067776:12345-0@lo:502:mount.lustre.0 Request processed in 262us (3860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846072.063869:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788846072.064020:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788846072.064368:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788846072.064430:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788846072.064481:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788846072.064532:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788846072.064567:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788846072.064625:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788846072.064671:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788846072.064710:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788846072.064745:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846072.064796:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846072.065846:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b30480 going to sleep for 11 seconds 00000100:00100000:1.0:1788846072.068617:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739067904 00000100:00100000:1.0:1788846072.068630:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739067904 00000100:00100000:1.0:1788846072.068734:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788846072.068745:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d3f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:15810:x1875740739067904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846072.070649:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d3f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:15810:x1875740739067904:12345-0@lo:502:mount.lustre.0 Request processed in 1900us (5846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846072.070662:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788846072.071941:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739067904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788846072.072303:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788846072.072320:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788846072.080108:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846072.080127:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846072.080129:0:15815:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788846072.080136:0:15815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a0c3d8b3800 00000020:00000080:0.0:1788846072.080139:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846072.080145:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846072.080148:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846072.080149:0:15815:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788846072.080170:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846072.080173:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846072.080175:0:15815:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788846072.080179:0:15815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a0c3d8b3800 00000020:00000080:0.0:1788846072.080182:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846072.080235:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846072.080249:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846072.080250:0:15815:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788846072.080253:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846072.080255:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846072.080257:0:15815:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788846072.080260:0:15815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a0c3d8b3800 00000020:00000080:0.0:1788846072.080262:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846072.080294:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846072.080297:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846072.080299:0:15815:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788846072.080301:0:15815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788846072.080535:0:15810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788846072.080563:0:15810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788846072.080585:0:15810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77400e8 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.080597:0:15810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77400e8 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846072.080641:0:15810:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788846072.080644:0:15810:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a0c3d8b3800 10000000:01000000:3.0:1788846072.080647:0:15810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a0c3d8b3800 10000000:01000000:3.0:1788846072.080651:0:15810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788846072.080657:0:15810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a0c3d8b3800 from 1 10000000:01000000:3.0:1788846072.080660:0:15810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788846072.080694:0:15810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475c00/0x1345bc80c77400ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.080703:0:15810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c01475c00/0x1345bc80c77400ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.080715:0:15810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c01475c00/0x1345bc80c77400ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846072.080747:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739068032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846072.080820:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846072.080861:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846072.086226:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739068032 00000100:00100000:0.0:1788846072.086237:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739068032 00000100:00100000:0.0:1788846072.086287:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788846072.086297:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ccc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:15810:x1875740739068032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846072.086313:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846072.086333:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c3ebce800/0x1345bc80c77400f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c77400ef expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846072.086373:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3ebce800/0x1345bc80c77400f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c77400ef expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846072.086385:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c3ebce800/0x1345bc80c77400f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c77400ef expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846072.086393:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3ebce800, rc 0) 00000100:00100000:0.0:1788846072.086462:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ccc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:15810:x1875740739068032:12345-0@lo:101:mount.lustre.0 Request processed in 167us (5642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846072.086468:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788846072.087214:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739068032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846072.087245:0:15810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c01475c00/0x1345bc80c77400ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77400f6 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.087258:0:15810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c01475c00/0x1345bc80c77400ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c77400f6 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788846072.087890:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788846072.089585:0:15810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788846072.089867:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788846072.089921:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788846072.089959:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788846072.090021:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788846072.090063:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788846072.090113:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788846072.090149:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788846072.090218:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788846072.090296:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788846072.090363:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788846072.090398:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788846072.090454:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788846072.090521:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788846072.090578:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788846072.090638:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788846072.090681:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788846072.090722:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788846072.090796:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788846072.090832:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788846072.090862:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788846072.090907:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788846072.090943:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788846072.090976:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788846072.091032:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788846072.091069:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788846072.091122:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788846072.094723:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788846072.094820:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788846072.094855:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788846072.094913:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788846072.095848:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788846072.095892:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788846072.097911:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788846072.098024:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788846072.098056:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788846072.098110:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788846072.098292:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788846072.098697:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788846072.098706:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788846072.098805:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739068160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846072.098945:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846072.098997:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846072.099138:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739068160 00000100:00100000:2.0:1788846072.099145:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739068160 00000100:00100000:2.0:1788846072.099226:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788846072.099235:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ccca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:15810:x1875740739068160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846072.099480:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ccca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:15810:x1875740739068160:12345-0@lo:501:mount.lustre.0 Request processed in 245us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846072.099489:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788846072.100663:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739068160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846072.100718:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739068288:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846072.100775:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846072.100809:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846072.101235:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739068288 00000100:00100000:2.0:1788846072.101242:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739068288 00000100:00100000:2.0:1788846072.101289:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788846072.101298:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ccca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:15810:x1875740739068288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846072.101483:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ccca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:15810:x1875740739068288:12345-0@lo:503:mount.lustre.0 Request processed in 186us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846072.101491:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788846072.102706:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739068288:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788846072.105312:0:15810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788846072.105467:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739068416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846072.105553:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846072.105764:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846072.106460:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739068416 00000100:00100000:2.0:1788846072.106469:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739068416 00000100:00100000:2.0:1788846072.106534:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788846072.106544:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ccca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:15810:x1875740739068416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846072.106794:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ccca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:15810:x1875740739068416:12345-0@lo:502:mount.lustre.0 Request processed in 251us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846072.106802:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788846072.106974:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739068416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846072.107351:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788846072.107403:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788846072.107449:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788846072.107499:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788846072.107552:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788846072.107610:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788846072.107653:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788846072.107695:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788846072.107749:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788846072.107784:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788846072.107822:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788846072.107875:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788846072.107911:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788846072.107948:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788846072.107998:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788846072.108039:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788846072.108093:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788846072.108149:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788846072.108259:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788846072.108304:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788846072.108380:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788846072.108414:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788846072.108454:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788846072.108519:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788846072.108561:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788846072.108609:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788846072.108658:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788846072.108698:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788846072.108735:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788846072.108804:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788846072.108844:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788846072.108880:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788846072.108946:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788846072.109023:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788846072.109071:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788846072.109121:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788846072.109189:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788846072.109233:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788846072.109286:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788846072.109332:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788846072.109381:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739068544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846072.109453:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846072.109499:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846072.109623:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739068544 00000100:00100000:2.0:1788846072.109631:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739068544 00000100:00100000:2.0:1788846072.109682:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788846072.109692:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3ccc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:15810:x1875740739068544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846072.109914:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3ccc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:15810:x1875740739068544:12345-0@lo:502:mount.lustre.0 Request processed in 223us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846072.109928:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788846072.113128:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739068544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846072.113368:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788846072.113385:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788846072.114269:0:15820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788846072.114285:0:15820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a0c347a3370) 00000020:00000080:0.0:1788846072.114313:0:15820:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788846072.114400:0:15820:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a0c3d8b3800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788846072.114405:0:15820:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a0c3d8b3800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788846072.114407:0:15820:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a0c3d8b3800 3 00010000:00080000:0.0:1788846072.114439:0:15820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a0c352fc000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.148@tcp at head 00010000:00010000:0.0:1788846072.116204:0:15820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788846072.116393:0:15820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788846072.116428:0:15820:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788846072.116440:0:15820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1345bc80c7740104 00000100:00080000:0.0:1788846072.116449:0:15820:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788846072.116455:0:15820:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a0c352fc000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1788846072.116490:0:15820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0c3d671c00 x1875740739068672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846072.116527:0:15820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788846072.117255:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846072.117261:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846072.117263:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846072.117266:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788846072.117321:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739068800:0@lo:400:kworker.0 00000100:00100000:2.0:1788846072.117389:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846072.117420:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846072.117427:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739068928:0@lo:400:kworker.0 00000100:00100000:2.0:1788846072.117457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846072.117494:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739068800 00000100:00100000:2.0:1788846072.117501:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739068800 00000100:00100000:2.0:1788846072.117552:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739068928 00000100:00100000:2.0:1788846072.117555:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739068928 00000100:00100000:1.0:1788846072.117591:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788846072.117603:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b05928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739068800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846072.117652:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875740739068672:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788846072.117696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846072.117842:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b05928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739068800:12345-0@lo:400:kworker.0 Request processed in 64us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846072.118821:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788846072.118852:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788846072.118884:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739068672 00000100:00100000:1.0:1788846072.118890:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739068672 00000100:00100000:1.0:1788846072.118907:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788846072.118912:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1875740739068672:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788846072.118934:0:14411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:1.0:1788846072.118963:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1345bc80c774010b 00000004:00100000:1.0:1788846072.118977:0:14411:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788846072.119002:0:14411:0:(import.c:65:import_set_state_nolock()) ffff9a0c3c96f800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1788846072.119273:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0b05928700 x1875740739068800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846072.119287:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739068800:0@lo:400:kworker.0 00000100:00100000:2.0:1788846072.119348:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0592b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739068928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846072.119546:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875740739068672:12345-0@lo:38:llog_process_th.0 Request processed in 632us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846072.119553:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788846072.119689:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0c3d671c00 x1875740739068672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846072.119700:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788846072.119706:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788846072.119714:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788846072.119718:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788846072.119729:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c352fc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788846072.119736:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875740739068672:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846072.120222:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0592b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739068928:12345-0@lo:400:kworker.0 Request processed in 1102us (2764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846072.120231:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788846072.120258:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788846072.122759:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:0.0:1788846072.124840:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a0b0592a680 x1875740739068928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846072.124858:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739068928:0@lo:400:kworker.0 00000020:01000000:0.0:1788846072.124894:0:15810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788846072.124926:0:15810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788846072.124950:0:15810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475c00/0x1345bc80c77400ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77400f6 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846072.124961:0:15810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c01475c00/0x1345bc80c77400ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77400f6 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788846072.125015:0:15810:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788846072.125018:0:15810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788846072.125019:0:15810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846072.125021:0:15810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846072.125022:0:15810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846072.125024:0:15810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846072.125025:0:15810:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788846072.125027:0:15810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846072.125028:0:15810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788846072.125032:0:15810:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788846072.125034:0:15810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788846072.125035:0:15810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788846072.125036:0:15810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846072.125037:0:15810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846072.125038:0:15810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846072.125039:0:15810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846072.125041:0:15810:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788846072.125042:0:15810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846072.125043:0:15810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788846072.125077:0:15810:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788846072.125095:0:15810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739069056:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788846072.125197:0:15810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846072.125232:0:15810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b30000 going to sleep for 11 seconds 00000100:00100000:3.0:1788846072.125404:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739069056 00000100:00100000:3.0:1788846072.125412:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739069056 00000100:00100000:3.0:1788846072.125460:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788846072.125469:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3cccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:15810:x1875740739069056:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788846072.125493:0:14405:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788846072.125517:0:14405:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788846072.154135:0:14405:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788846072.154182:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788846072.154497:0:14426:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788846072.154502:0:14426:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788846072.154532:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.154551:0:14426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0b04375600/0x1345bc80c77400b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c77400a9 expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.154559:0:14426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.154598:0:14426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0b04375600/0x1345bc80c77400b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c77400a9 expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.154612:0:14426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0b04375600/0x1345bc80c77400b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c77400a9 expref: 19 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846072.154626:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14426:1875740739069184:0@lo:104: 00000100:00100000:3.0:1788846072.154684:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846072.154723:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c31165480 going to sleep for 11 seconds 00000100:00100000:3.0:1788846072.154741:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739069184 00000100:00100000:3.0:1788846072.154747:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739069184 00000100:00100000:3.0:1788846072.154803:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788846072.154811:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+3:14426:x1875740739069184:12345-0@lo:104: 00010000:00010000:3.0:1788846072.154824:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c77400b0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.154874:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788846072.154880:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+3:14426:x1875740739069184:12345-0@lo:104: Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846072.154886:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788846072.154907:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846072.154913:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c77400b0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.154921:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce000 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:3.0:1788846072.154925:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c77400b0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.154932:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c77400b0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846072.154940:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c77400b0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846072.154946:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788846072.154972:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c77400b0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.154979:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846072.154998:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c77400b0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155015:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c3ebce000/0x1345bc80c77400a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c77400b0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155042:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846072.155045:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846072.155046:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846072.155059:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ac7e2af-29a9-4384-8c8c-a41d76049816:3309:1875740739069312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846072.155088:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846072.155128:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739069312 00000100:00100000:3.0:1788846072.155131:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739069312 00010000:00010000:3.0:1788846072.155148:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0b04375600/0x1345bc80c77400b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c77400a9 expref: 20 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846072.155195:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788846072.155202:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ac7e2af-29a9-4384-8c8c-a41d76049816+20:3309:x1875740739069312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846072.155212:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846072.155217:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0b04375600/0x1345bc80c77400b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c77400a9 expref: 20 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155226:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0b04375600/0x1345bc80c77400b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c77400a9 expref: 20 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155242:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155251:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788846072.155263:0:14397:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001458645s 00010000:00010000:3.0:1788846072.155275:0:14397:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155281:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155288:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155294:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155299:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475e00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846072.155302:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155308:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155316:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155325:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846072.155610:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ac7e2af-29a9-4384-8c8c-a41d76049816+20:3309:x1875740739069312:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846072.155619:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788846072.155658:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ac7e2af-29a9-4384-8c8c-a41d76049816:3309:1875740739069312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846072.155686:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0b04375600/0x1345bc80c77400b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c77400a9 expref: 19 pid: 14403 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846072.155696:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14426:1875740739069184:0@lo:104: 00010000:00010000:3.0:1788846072.155715:0:14426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155724:0:14426:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155729:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846072.155736:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01475e00/0x1345bc80c7740112 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846072.163692:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3cccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:15810:x1875740739069056:12345-0@lo:253:mount.lustre.0 Request processed in 38214us (38485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846072.163705:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788846072.163789:0:15810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3ac7e2af-29a9-4384-8c8c-a41d76049816:15810:1875740739069056:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788846072.163804:0:15810:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788846072.163807:0:15810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788846072.163809:0:15810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788846072.163810:0:15810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846072.163811:0:15810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846072.163812:0:15810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846072.163813:0:15810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846072.163815:0:15810:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788846072.163830:0:15810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846072.163832:0:15810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788846072.163855:0:15810:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788846072.168832:0:15810:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788846072.168999:0:15810:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788846072.169448:0:15810:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788846072.169622:0:15810:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788846072.169798:0:15810:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788846072.170017:0:15810:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788846072.170937:0:15810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788846072.211612:0:15810:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788846072.211620:0:15810:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788846072.211653:0:15810:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788846072.211714:0:15810:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788846072.211729:0:15810:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788846072.211754:0:15810:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788846072.294325:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846073.126276:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846057/real 1788846057] req@ffff9a0b0592bb80 x1875740739062144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846072 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846073.126301:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a0b0592bb80 x1875740739062144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846072 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846073.126308:0:3306:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846057/real 1788846057] req@ffff9a0b05929880 x1875740739062272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846072 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846073.126316:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a0b05929880 x1875740739062272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846072 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788846073.126329:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c074be800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788846073.126397:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788846073.126402:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739062144:0@lo:8:kworker.0 00000100:00080000:3.0:1788846073.126408:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c3eb16800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788846073.126523:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ac7e2af-29a9-4384-8c8c-a41d76049816:3310:1875740739069440:0@lo:400:kworker.0 00000100:00100000:1.0:1788846073.126588:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788846073.126629:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788846073.126633:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739062272:0@lo:8:kworker.0 00000100:00080000:2.0:1788846073.126655:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846073.126659:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788846073.126662:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a0c074be800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846073.126666:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 389 00000100:00080000:2.0:1788846073.126677:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788846073.126682:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a0c074be800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1788846073.126703:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0b0592b800 x1875740739069568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788846073.126717:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846073.126720:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788846073.126721:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a0c3eb16800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846073.126724:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 389 00000100:00080000:2.0:1788846073.126726:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788846073.126729:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a0c3eb16800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1788846073.126738:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a0b05929180 x1875740739069696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788846073.126803:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788846073.126814:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875740739070080:0@lo:400:kworker.0 00000100:00100000:2.0:1788846073.126834:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739069824:0@lo:400:kworker.0 00000100:00100000:1.0:1788846073.126846:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846073.126862:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875740739069952:0@lo:400:kworker.0 00000100:00100000:2.0:1788846073.126891:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739069568:0@lo:8:kworker.0 00000100:00100000:2.0:1788846073.126932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846073.126948:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739069696:0@lo:8:kworker.0 00000100:00100000:1.0:1788846073.126950:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739069440 00000100:00100000:1.0:1788846073.126957:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739069440 00000100:00100000:2.0:1788846073.126967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846073.126998:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788846073.127007:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:3310:x1875740739069440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846073.127060:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:3310:x1875740739069440:12345-0@lo:400:kworker.0 Request processed in 53us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846073.127067:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788846073.127100:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846073.127180:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739069568 00000100:00100000:0.0:1788846073.127185:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739069568 00000100:00100000:0.0:1788846073.127203:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739069696 00000100:00100000:0.0:1788846073.127206:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739069696 00000100:00100000:0.0:1788846073.127216:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788846073.127221:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b05929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875740739069568:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788846073.127243:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ac7e2af-29a9-4384-8c8c-a41d76049816:3310:1875740739069440:0@lo:400:kworker.0 00010000:00080000:0.0:1788846073.127243:0:15093:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:0.0:1788846073.127269:0:15093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1345bc80c7740119 00002000:00100000:0.0:1788846073.127282:0:15093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a0c352f9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788846073.127286:0:15093:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788846073.127289:0:15093:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788846073.127601:0:15093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788846073.127624:0:15093:0:(import.c:65:import_set_state_nolock()) ffff9a0c352fd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788846073.127674:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b05929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875740739069568:12345-0@lo:8:kworker.0 Request processed in 452us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846073.127681:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788846073.127695:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788846073.127698:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0592bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875740739069696:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788846073.127712:0:15093:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:0.0:1788846073.127727:0:15093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1345bc80c7740120 00002000:00100000:0.0:1788846073.127740:0:15093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a0c352f8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788846073.127743:0:15093:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788846073.127745:0:15093:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1788846073.127816:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b0592b800 x1875740739069568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788846093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846073.127826:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846073.127832:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788846073.127844:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788846073.127848:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788846073.127851:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c074be800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788846073.127865:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788846073.127869:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739069568:0@lo:8:kworker.0 00000004:00080000:2.0:1788846073.127909:0:14433:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788846073.127923:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14433:1875740739070336:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788846073.127948:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788846073.127953:0:15093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1788846073.127959:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d22c300 going to sleep for 11 seconds 00000100:00080000:0.0:1788846073.127966:0:15093:0:(import.c:65:import_set_state_nolock()) ffff9a0c352ff800 : changing import state from RECOVER to FULL 00000004:00080000:2.0:1788846073.127971:0:14432:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788846073.127997:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0592bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875740739069696:12345-0@lo:8:kworker.0 Request processed in 297us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846073.128004:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788846073.128014:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739070336 00000100:00100000:0.0:1788846073.128017:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739070336 00000100:00100000:0.0:1788846073.128039:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788846073.128044:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0592a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14433:x1875740739070336:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788846073.128364:0:14432:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 405345210239ns, next at 0ns, rc = 0 00000100:00080000:2.0:1788846073.128383:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788846073.128614:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788846073.128625:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b0592b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739070208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788846073.128653:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788846073.129120:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b05929180 x1875740739069696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788846093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846073.129129:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846073.129135:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788846073.129141:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788846073.129145:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788846073.129147:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a0c3eb16800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788846073.129179:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788846073.129184:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875740739069696:0@lo:8:kworker.0 00000004:00080000:2.0:1788846073.129223:0:14435:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788846073.129238:0:14435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14435:1875740739070592:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788846073.129270:0:14435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846073.129285:0:14435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c0974cf00 going to sleep for 11 seconds 00000004:00080000:2.0:1788846073.129296:0:14434:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788846073.129491:0:15094:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788846073.129498:0:15094:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:2.0:1788846073.129741:0:14434:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 405346586789ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788846073.130431:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b05929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739070464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846073.130469:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846073.130634:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739070208 00000100:00100000:0.0:1788846073.130640:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739070208 00000100:00100000:0.0:1788846073.130665:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739070464 00000100:00100000:0.0:1788846073.130668:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739070464 00000100:00100000:0.0:1788846073.130690:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788846073.130697:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b05928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875740739070208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788846073.130743:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788846073.130789:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b05928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875740739070208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846073.130796:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788846073.130812:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788846073.130819:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d674000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739070464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788846073.130829:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788846073.130860:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d674000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739070464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846073.130876:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788846073.131006:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739070080 00000100:00100000:3.0:1788846073.131011:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739070080 00000100:00100000:2.0:1788846073.131025:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739069824 00000100:00100000:2.0:1788846073.131028:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739069824 00000100:00100000:2.0:1788846073.131061:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788846073.131068:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875740739070080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846073.131107:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875740739070080:12345-0@lo:400:kworker.0 Request processed in 40us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846073.131113:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788846073.131126:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788846073.131132:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739069824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846073.131281:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875740739069824:12345-0@lo:400:kworker.0 Request processed in 149us (4180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846073.131287:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788846073.131328:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846073.132045:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739069952 00000100:00100000:2.0:1788846073.132052:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739069952 00000100:00100000:2.0:1788846073.132080:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788846073.132087:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875740739069952:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788846073.132267:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788846073.132272:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788846073.132273:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875740739069952:12345-0@lo:400:kworker.0 Request processed in 187us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846073.132280:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788846073.132314:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b05929f80 x1875740739069952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846073.132346:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875740739069952:0@lo:400:kworker.0 00010000:00080000:0.0:1788846073.132466:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b0592b800 x1875740739070208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788846073.132481:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b05929500 x1875740739070080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846073.132482:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739070208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788846073.132491:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875740739070080:0@lo:400:kworker.0 00010000:00080000:0.0:1788846073.132580:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b05929180 x1875740739070464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846073.132594:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739070464:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788846073.132607:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0b05928a80 x1875740739069824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846073.132613:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b05928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875740739069824:0@lo:400:kworker.0 00002000:00080000:0.0:1788846073.133574:0:15093:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788846073.133581:0:15093:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788846073.133585:0:15093:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:1.0:1788846073.136436:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739070592 00000100:00100000:1.0:1788846073.136450:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739070592 00000100:00100000:1.0:1788846073.136574:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788846073.136583:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14435:x1875740739070592:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788846073.139831:0:15891:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788846073.139840:0:15891:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788846073.139845:0:15891:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1788846073.140956:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.140965:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c7740127 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141107:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.141113:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.141120:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c7740127 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141138:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c7740127 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141300:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c7740127 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141308:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c7740127 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141325:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.141336:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.141342:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c7740127 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141359:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcfa00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.141364:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c7740127 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141373:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c7740127 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141388:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c7740127 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141396:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b45ce56a/0x1345bc80c7740127 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141413:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.141423:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.141425:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.141832:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.141838:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d4a525b/0x1345bc80c774012e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141847:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.141850:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.141854:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d4a525b/0x1345bc80c774012e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141863:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d4a525b/0x1345bc80c774012e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141870:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d4a525b/0x1345bc80c774012e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141877:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d4a525b/0x1345bc80c774012e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141889:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.141896:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.141900:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d4a525b/0x1345bc80c774012e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141907:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.141910:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d4a525b/0x1345bc80c774012e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141930:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d4a525b/0x1345bc80c774012e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141942:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d4a525b/0x1345bc80c774012e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141949:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d4a525b/0x1345bc80c774012e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.141962:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.141964:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.141965:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.142381:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.142388:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1e72b8/0x1345bc80c7740135 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.142397:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.142400:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.142404:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e72b8/0x1345bc80c7740135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.142413:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c1e72b8/0x1345bc80c7740135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.142421:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1e72b8/0x1345bc80c7740135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.142434:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e72b8/0x1345bc80c7740135 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.142448:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.142457:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.142461:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c1e72b8/0x1345bc80c7740135 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.142468:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.142471:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1e72b8/0x1345bc80c7740135 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.142479:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1e72b8/0x1345bc80c7740135 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.142490:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c1e72b8/0x1345bc80c7740135 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.142498:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c1e72b8/0x1345bc80c7740135 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.142524:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.142526:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.142527:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.143589:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.143604:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63fb904/0x1345bc80c774013c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.143615:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.143619:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.143624:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b63fb904/0x1345bc80c774013c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.143634:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b63fb904/0x1345bc80c774013c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.143643:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b63fb904/0x1345bc80c774013c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.143650:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b63fb904/0x1345bc80c774013c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.143665:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.143676:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.143680:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b63fb904/0x1345bc80c774013c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.143687:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf200 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.143691:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63fb904/0x1345bc80c774013c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.143697:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b63fb904/0x1345bc80c774013c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.143715:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b63fb904/0x1345bc80c774013c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.143721:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b63fb904/0x1345bc80c774013c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.143736:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.143737:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.143739:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.144377:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.144384:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b1a2a2/0x1345bc80c7740143 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.144393:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.144397:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.144401:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076b1a2a2/0x1345bc80c7740143 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.144409:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076b1a2a2/0x1345bc80c7740143 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.144418:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076b1a2a2/0x1345bc80c7740143 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.144424:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076b1a2a2/0x1345bc80c7740143 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.144448:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.144458:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.144461:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076b1a2a2/0x1345bc80c7740143 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.144468:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcec00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.144471:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b1a2a2/0x1345bc80c7740143 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.144479:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076b1a2a2/0x1345bc80c7740143 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.144490:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076b1a2a2/0x1345bc80c7740143 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.144498:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076b1a2a2/0x1345bc80c7740143 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.144610:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.144612:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.144614:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.148218:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.148231:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18b8a4b/0x1345bc80c774014a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148248:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.148262:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.148269:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f18b8a4b/0x1345bc80c774014a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148284:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f18b8a4b/0x1345bc80c774014a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148294:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18b8a4b/0x1345bc80c774014a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148303:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f18b8a4b/0x1345bc80c774014a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148321:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.148334:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.148339:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f18b8a4b/0x1345bc80c774014a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148347:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.148352:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18b8a4b/0x1345bc80c774014a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148360:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18b8a4b/0x1345bc80c774014a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148375:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f18b8a4b/0x1345bc80c774014a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148394:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f18b8a4b/0x1345bc80c774014a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148413:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.148415:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.148416:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.148907:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.148914:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a65092d3/0x1345bc80c7740151 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148923:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.148927:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.148931:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a65092d3/0x1345bc80c7740151 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148941:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a65092d3/0x1345bc80c7740151 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148949:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a65092d3/0x1345bc80c7740151 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148957:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a65092d3/0x1345bc80c7740151 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.148986:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.148996:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.149006:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a65092d3/0x1345bc80c7740151 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149014:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.149018:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a65092d3/0x1345bc80c7740151 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149027:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a65092d3/0x1345bc80c7740151 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149040:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a65092d3/0x1345bc80c7740151 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149048:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a65092d3/0x1345bc80c7740151 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149062:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.149063:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.149065:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.149455:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.149461:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c7740158 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149470:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.149473:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.149477:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c7740158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149669:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c7740158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149679:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c7740158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149686:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c7740158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149701:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.149709:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.149713:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c7740158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149720:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebcf400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.149724:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c7740158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149731:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c7740158 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149742:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c7740158 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149748:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4931d99/0x1345bc80c7740158 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.149769:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.149771:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.149773:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.150350:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.150357:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2aaab29/0x1345bc80c774015f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150366:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.150370:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.150374:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2aaab29/0x1345bc80c774015f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150382:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2aaab29/0x1345bc80c774015f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150390:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2aaab29/0x1345bc80c774015f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150397:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2aaab29/0x1345bc80c774015f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150412:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.150420:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.150424:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2aaab29/0x1345bc80c774015f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150442:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3ebce000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.150445:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2aaab29/0x1345bc80c774015f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150453:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2aaab29/0x1345bc80c774015f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150464:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2aaab29/0x1345bc80c774015f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150472:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2aaab29/0x1345bc80c774015f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150485:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.150486:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.150488:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.150876:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.150882:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba2a99a4/0x1345bc80c7740166 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150891:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.150894:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.150899:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba2a99a4/0x1345bc80c7740166 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150908:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba2a99a4/0x1345bc80c7740166 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150922:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba2a99a4/0x1345bc80c7740166 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150928:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba2a99a4/0x1345bc80c7740166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150941:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.150949:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.150952:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba2a99a4/0x1345bc80c7740166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150958:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c8200 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.150962:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba2a99a4/0x1345bc80c7740166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.150969:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba2a99a4/0x1345bc80c7740166 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.151128:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba2a99a4/0x1345bc80c7740166 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.151136:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba2a99a4/0x1345bc80c7740166 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.151182:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.151191:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.151193:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.151566:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.151571:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065cf2322/0x1345bc80c774016d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.151579:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.151583:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.151587:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065cf2322/0x1345bc80c774016d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.151595:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065cf2322/0x1345bc80c774016d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.151603:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065cf2322/0x1345bc80c774016d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.151609:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065cf2322/0x1345bc80c774016d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.151623:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.151630:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.151634:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065cf2322/0x1345bc80c774016d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.151640:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.151643:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065cf2322/0x1345bc80c774016d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.151662:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065cf2322/0x1345bc80c774016d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.151673:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065cf2322/0x1345bc80c774016d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.151680:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065cf2322/0x1345bc80c774016d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.151693:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.151695:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.151697:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.152332:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.152339:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d46302b/0x1345bc80c7740174 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152349:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.152352:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.152357:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d46302b/0x1345bc80c7740174 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152366:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d46302b/0x1345bc80c7740174 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152373:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d46302b/0x1345bc80c7740174 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152386:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d46302b/0x1345bc80c7740174 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152399:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.152409:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.152413:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d46302b/0x1345bc80c7740174 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152419:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030800 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.152423:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d46302b/0x1345bc80c7740174 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152431:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d46302b/0x1345bc80c7740174 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152442:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d46302b/0x1345bc80c7740174 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152450:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d46302b/0x1345bc80c7740174 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152464:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.152465:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.152467:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.152848:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.152860:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000069ee8b3/0x1345bc80c774017b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152869:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.152872:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.152877:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000069ee8b3/0x1345bc80c774017b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152887:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000069ee8b3/0x1345bc80c774017b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152895:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000069ee8b3/0x1345bc80c774017b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152903:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000069ee8b3/0x1345bc80c774017b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152917:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.152925:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.152929:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000069ee8b3/0x1345bc80c774017b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152936:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.152939:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000069ee8b3/0x1345bc80c774017b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152947:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000069ee8b3/0x1345bc80c774017b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152964:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000069ee8b3/0x1345bc80c774017b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.152972:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000069ee8b3/0x1345bc80c774017b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.153478:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.153480:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.153482:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.153919:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.153925:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b597a7/0x1345bc80c7740182 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.153935:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.153938:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.153943:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b597a7/0x1345bc80c7740182 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.153954:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b597a7/0x1345bc80c7740182 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.153963:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b597a7/0x1345bc80c7740182 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.153970:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039b597a7/0x1345bc80c7740182 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.155094:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.155105:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.155110:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039b597a7/0x1345bc80c7740182 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.155119:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030e00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.155123:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b597a7/0x1345bc80c7740182 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.155131:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b597a7/0x1345bc80c7740182 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.155406:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039b597a7/0x1345bc80c7740182 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.155416:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039b597a7/0x1345bc80c7740182 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.155433:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.155434:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.155436:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.155914:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.155921:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002305dab6/0x1345bc80c7740189 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.155932:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.155942:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.155948:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002305dab6/0x1345bc80c7740189 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.155959:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002305dab6/0x1345bc80c7740189 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.155968:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002305dab6/0x1345bc80c7740189 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.158849:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002305dab6/0x1345bc80c7740189 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159007:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788846073.159588:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.159595:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a562b5/0x1345bc80c7740190 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159609:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.159613:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.159620:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a562b5/0x1345bc80c7740190 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159633:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a562b5/0x1345bc80c7740190 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159643:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a562b5/0x1345bc80c7740190 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159659:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a562b5/0x1345bc80c7740190 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159675:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788846073.159687:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788846073.159693:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002305dab6/0x1345bc80c7740189 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159700:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.159704:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002305dab6/0x1345bc80c7740189 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159714:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002305dab6/0x1345bc80c7740189 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159731:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002305dab6/0x1345bc80c7740189 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159739:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002305dab6/0x1345bc80c7740189 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159755:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.159758:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8a562b5/0x1345bc80c7740190 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159774:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031200 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.159777:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a562b5/0x1345bc80c7740190 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159785:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a562b5/0x1345bc80c7740190 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159796:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8a562b5/0x1345bc80c7740190 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159804:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8a562b5/0x1345bc80c7740190 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.159817:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.159818:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.159820:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.160232:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.160238:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000913c78ca/0x1345bc80c7740197 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.160248:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.160251:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.160255:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000913c78ca/0x1345bc80c7740197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.160265:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000913c78ca/0x1345bc80c7740197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.160280:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000913c78ca/0x1345bc80c7740197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.160288:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000913c78ca/0x1345bc80c7740197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.160302:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.160310:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.160313:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000913c78ca/0x1345bc80c7740197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.160320:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00031000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.160324:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000913c78ca/0x1345bc80c7740197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.160331:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000913c78ca/0x1345bc80c7740197 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.160343:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000913c78ca/0x1345bc80c7740197 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.160472:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.160937:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000913c78ca/0x1345bc80c7740197 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.160953:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.160961:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.160963:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.161845:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.161853:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c774019e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.161865:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.161869:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.161875:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c774019e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.161886:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c774019e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.161895:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c774019e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.161902:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c774019e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.161915:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846073.162170:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846073.162177:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c774019e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.162184:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.162188:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c774019e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.162196:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c774019e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.162213:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c774019e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.162220:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006940cc2b/0x1345bc80c774019e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.162236:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846073.162237:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846073.162239:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.162331:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.162340:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c77401a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.162349:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=405s v=(0 0) 00000004:00080000:3.0:1788846073.162552:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788846073.163000:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.163007:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb3d190e/0x1345bc80c77401ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.163017:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.163021:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.163026:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb3d190e/0x1345bc80c77401ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.163173:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.163178:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c77401a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.163203:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c77401a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.163212:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c77401a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.163219:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c77401a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.163265:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.163265:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb3d190e/0x1345bc80c77401ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.163276:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb3d190e/0x1345bc80c77401ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.163282:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb3d190e/0x1345bc80c77401ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.163292:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788846073.163686:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.163691:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c0861f7/0x1345bc80c77401b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.163700:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.163703:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.163707:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c0861f7/0x1345bc80c77401b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.163715:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c0861f7/0x1345bc80c77401b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.163722:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c0861f7/0x1345bc80c77401b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.163740:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c0861f7/0x1345bc80c77401b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.163747:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788846073.163856:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.163861:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c77401ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.163870:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.163873:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.163877:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c77401ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.163886:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c77401ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.163951:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c77401ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.163968:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c77401ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.163981:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788846073.164105:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.164110:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4286d22/0x1345bc80c77401c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.164119:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.164122:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.164126:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4286d22/0x1345bc80c77401c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.164135:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4286d22/0x1345bc80c77401c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.164143:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4286d22/0x1345bc80c77401c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.164181:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4286d22/0x1345bc80c77401c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.164190:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788846073.164495:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.164511:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063a8abee/0x1345bc80c77401c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.164520:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.164523:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.164527:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063a8abee/0x1345bc80c77401c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.164536:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063a8abee/0x1345bc80c77401c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.164544:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063a8abee/0x1345bc80c77401c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.164551:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063a8abee/0x1345bc80c77401c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.164559:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788846073.164563:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.164568:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c19ac2b5/0x1345bc80c77401cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.164581:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.164584:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.164588:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c19ac2b5/0x1345bc80c77401cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.164597:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c19ac2b5/0x1345bc80c77401cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.164604:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c19ac2b5/0x1345bc80c77401cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.164611:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c19ac2b5/0x1345bc80c77401cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.164619:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788846073.164885:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.164891:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcde78a8/0x1345bc80c77401d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.164904:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.164906:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.164910:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcde78a8/0x1345bc80c77401d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.164919:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcde78a8/0x1345bc80c77401d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.164927:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcde78a8/0x1345bc80c77401d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.164933:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcde78a8/0x1345bc80c77401d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.164941:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1788846073.165236:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.165242:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072bc27d4/0x1345bc80c77401dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.165249:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.165252:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.165256:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072bc27d4/0x1345bc80c77401dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.165265:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072bc27d4/0x1345bc80c77401dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.165285:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072bc27d4/0x1345bc80c77401dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.165292:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072bc27d4/0x1345bc80c77401dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.165300:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1788846073.165638:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.165644:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099fdc690/0x1345bc80c77401e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.165652:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.165655:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.165659:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099fdc690/0x1345bc80c77401e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.165667:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099fdc690/0x1345bc80c77401e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.165675:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099fdc690/0x1345bc80c77401e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.165682:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099fdc690/0x1345bc80c77401e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.165698:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1788846073.166007:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.166012:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024a429a0/0x1345bc80c77401eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.166021:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.166024:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.166028:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024a429a0/0x1345bc80c77401eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.166036:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024a429a0/0x1345bc80c77401eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.166044:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024a429a0/0x1345bc80c77401eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166232:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1788846073.166239:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c77401a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166258:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.166263:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c77401a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166272:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c77401a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166290:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c77401a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166297:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000086da74d/0x1345bc80c77401a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166314:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788846073.166318:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb3d190e/0x1345bc80c77401ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166324:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.166327:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb3d190e/0x1345bc80c77401ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166334:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb3d190e/0x1345bc80c77401ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166342:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb3d190e/0x1345bc80c77401ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166354:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb3d190e/0x1345bc80c77401ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166366:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788846073.166369:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c0861f7/0x1345bc80c77401b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166375:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c00030c00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.166378:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c0861f7/0x1345bc80c77401b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166386:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c0861f7/0x1345bc80c77401b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166395:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c0861f7/0x1345bc80c77401b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166401:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c0861f7/0x1345bc80c77401b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166409:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788846073.166413:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c77401ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166418:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01200 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.166425:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c77401ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166433:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c77401ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166442:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c77401ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166448:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074333880/0x1345bc80c77401ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166458:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788846073.166462:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4286d22/0x1345bc80c77401c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166467:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c4800 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.166470:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4286d22/0x1345bc80c77401c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166477:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4286d22/0x1345bc80c77401c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166485:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4286d22/0x1345bc80c77401c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166492:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4286d22/0x1345bc80c77401c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166517:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788846073.166521:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063a8abee/0x1345bc80c77401c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166528:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.166531:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063a8abee/0x1345bc80c77401c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166538:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063a8abee/0x1345bc80c77401c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166547:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063a8abee/0x1345bc80c77401c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166554:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063a8abee/0x1345bc80c77401c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166564:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788846073.166567:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c19ac2b5/0x1345bc80c77401cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166574:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c5400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.166576:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c19ac2b5/0x1345bc80c77401cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166592:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c19ac2b5/0x1345bc80c77401cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166601:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c19ac2b5/0x1345bc80c77401cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166608:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c19ac2b5/0x1345bc80c77401cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166619:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788846073.166622:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcde78a8/0x1345bc80c77401d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166629:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01800 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.166632:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcde78a8/0x1345bc80c77401d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166639:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcde78a8/0x1345bc80c77401d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166647:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcde78a8/0x1345bc80c77401d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166653:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcde78a8/0x1345bc80c77401d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166671:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846073.166674:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072bc27d4/0x1345bc80c77401dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166680:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c5800 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.166683:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072bc27d4/0x1345bc80c77401dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166691:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072bc27d4/0x1345bc80c77401dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166700:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072bc27d4/0x1345bc80c77401dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166706:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072bc27d4/0x1345bc80c77401dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166715:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846073.166719:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099fdc690/0x1345bc80c77401e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166724:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c4e00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.166727:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099fdc690/0x1345bc80c77401e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166743:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099fdc690/0x1345bc80c77401e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166751:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099fdc690/0x1345bc80c77401e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166758:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099fdc690/0x1345bc80c77401e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.166768:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846073.166769:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846073.166771:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846073.166777:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.167130:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024a429a0/0x1345bc80c77401eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.167484:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788846073.167930:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.167936:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057f1b776/0x1345bc80c77401f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.167948:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.167955:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.167961:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057f1b776/0x1345bc80c77401f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.167973:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057f1b776/0x1345bc80c77401f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.167981:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057f1b776/0x1345bc80c77401f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.167988:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057f1b776/0x1345bc80c77401f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.168000:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788846073.168782:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.168790:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb786b1/0x1345bc80c77401f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.168800:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.168804:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.168809:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afb786b1/0x1345bc80c77401f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.168818:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afb786b1/0x1345bc80c77401f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168821:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846073.168828:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024a429a0/0x1345bc80c77401eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168836:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c4600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846073.168837:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afb786b1/0x1345bc80c77401f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168840:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024a429a0/0x1345bc80c77401eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.168845:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afb786b1/0x1345bc80c77401f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168850:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024a429a0/0x1345bc80c77401eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.168852:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788846073.168864:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024a429a0/0x1345bc80c77401eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168881:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024a429a0/0x1345bc80c77401eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168901:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846073.168905:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057f1b776/0x1345bc80c77401f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168912:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c4400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.168915:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057f1b776/0x1345bc80c77401f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168923:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057f1b776/0x1345bc80c77401f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168933:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057f1b776/0x1345bc80c77401f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168940:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057f1b776/0x1345bc80c77401f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168951:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846073.168954:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afb786b1/0x1345bc80c77401f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168961:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.168968:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb786b1/0x1345bc80c77401f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168975:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afb786b1/0x1345bc80c77401f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168986:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afb786b1/0x1345bc80c77401f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.168993:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afb786b1/0x1345bc80c77401f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.169007:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846073.169008:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846073.169010:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846073.169015:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846073.170679:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788846073.170689:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075c7e60f/0x1345bc80c7740200 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.170703:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788846073.170708:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846073.170713:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075c7e60f/0x1345bc80c7740200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.170726:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075c7e60f/0x1345bc80c7740200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.170734:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075c7e60f/0x1345bc80c7740200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.170748:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075c7e60f/0x1345bc80c7740200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.170810:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788846073.171034:0:15093:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1788846073.171132:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0592a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14433:x1875740739070336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 43083us (43179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846073.171142:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788846073.171219:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b0592a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14433:1875740739070336:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788846073.171234:0:14433:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788846073.171277:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14433:1875740739070720:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788846073.171310:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846073.171341:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c3d3f4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788846073.171357:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739070720 00000100:00100000:0.0:1788846073.171362:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739070720 00000100:00100000:0.0:1788846073.171396:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788846073.171405:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14433:x1875740739070720:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788846073.171440:0:15094:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00002000:00010000:1.0:1788846073.171789:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.171796:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c7740207 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.171807:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.171811:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.171815:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c7740207 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.171825:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c7740207 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.171833:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c7740207 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.171840:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c7740207 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.174660:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788846073.174673:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075c7e60f/0x1345bc80c7740200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.174686:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c4000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:2.0:1788846073.174691:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075c7e60f/0x1345bc80c7740200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.174701:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075c7e60f/0x1345bc80c7740200 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.174723:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075c7e60f/0x1345bc80c7740200 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.174731:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075c7e60f/0x1345bc80c7740200 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.174752:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846073.174757:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c7740207 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.174774:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:2.0:1788846073.174778:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c7740207 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.174786:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c7740207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.174797:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c7740207 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.174806:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846073.174808:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846073.174810:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.176705:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788846073.176716:0:15891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068dda533/0x1345bc80c7740207 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.176982:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.177298:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.177306:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d782210/0x1345bc80c774020e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.177321:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.177325:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.177331:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d782210/0x1345bc80c774020e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.177345:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d782210/0x1345bc80c774020e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.177564:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d782210/0x1345bc80c774020e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.177574:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d782210/0x1345bc80c774020e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.177592:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846073.177601:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846073.177606:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d782210/0x1345bc80c774020e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.177619:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846073.177624:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d782210/0x1345bc80c774020e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.177633:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d782210/0x1345bc80c774020e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.177651:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d782210/0x1345bc80c774020e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.177658:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d782210/0x1345bc80c774020e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.177673:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.177675:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.177677:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.178095:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.178101:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee15ecc4/0x1345bc80c7740215 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178110:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.178114:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.178119:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee15ecc4/0x1345bc80c7740215 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178127:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee15ecc4/0x1345bc80c7740215 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178252:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee15ecc4/0x1345bc80c7740215 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178260:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee15ecc4/0x1345bc80c7740215 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178273:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846073.178282:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846073.178286:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee15ecc4/0x1345bc80c7740215 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178293:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00e00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846073.178296:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee15ecc4/0x1345bc80c7740215 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178304:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee15ecc4/0x1345bc80c7740215 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178316:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee15ecc4/0x1345bc80c7740215 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178322:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee15ecc4/0x1345bc80c7740215 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178335:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.178342:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.178344:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.178894:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.178901:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009de32082/0x1345bc80c774021c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178910:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.178914:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.178918:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009de32082/0x1345bc80c774021c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178927:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009de32082/0x1345bc80c774021c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178935:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009de32082/0x1345bc80c774021c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178942:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009de32082/0x1345bc80c774021c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178956:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846073.178964:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846073.178969:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009de32082/0x1345bc80c774021c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178975:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a00800 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846073.178979:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009de32082/0x1345bc80c774021c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.178996:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009de32082/0x1345bc80c774021c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.179008:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009de32082/0x1345bc80c774021c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.179015:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009de32082/0x1345bc80c774021c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.179029:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.179031:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.179033:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.180940:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.180951:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8c1ea6b/0x1345bc80c7740223 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.180967:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.180971:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.180976:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8c1ea6b/0x1345bc80c7740223 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.180988:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8c1ea6b/0x1345bc80c7740223 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.180996:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8c1ea6b/0x1345bc80c7740223 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.181010:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8c1ea6b/0x1345bc80c7740223 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.181036:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788846073.182500:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.182521:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c774022a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182535:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.182539:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.182544:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c774022a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182555:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c774022a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182564:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c774022a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182571:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c774022a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182589:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788846073.182600:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788846073.182605:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8c1ea6b/0x1345bc80c7740223 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182618:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01e00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846073.182622:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8c1ea6b/0x1345bc80c7740223 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182631:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8c1ea6b/0x1345bc80c7740223 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182647:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8c1ea6b/0x1345bc80c7740223 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182655:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8c1ea6b/0x1345bc80c7740223 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182672:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846073.182676:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c774022a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182683:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01a00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846073.182686:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c774022a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182692:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c774022a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182702:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c774022a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182716:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8b8e213/0x1345bc80c774022a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.182728:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.182730:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.182732:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.183119:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.183126:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0ceca6b/0x1345bc80c7740231 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.183134:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.183138:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.183142:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ceca6b/0x1345bc80c7740231 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.183168:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0ceca6b/0x1345bc80c7740231 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.183177:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0ceca6b/0x1345bc80c7740231 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.183184:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ceca6b/0x1345bc80c7740231 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.183197:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846073.183205:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846073.183214:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0ceca6b/0x1345bc80c7740231 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.183221:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824800 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846073.183224:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0ceca6b/0x1345bc80c7740231 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.183232:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0ceca6b/0x1345bc80c7740231 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.183243:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0ceca6b/0x1345bc80c7740231 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.183250:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0ceca6b/0x1345bc80c7740231 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.183263:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.183264:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.183266:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846073.183771:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.184440:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.184448:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52f36d3/0x1345bc80c7740238 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.184461:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.184465:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.184469:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52f36d3/0x1345bc80c7740238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.184491:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52f36d3/0x1345bc80c7740238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.184510:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d52f36d3/0x1345bc80c7740238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.184518:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d52f36d3/0x1345bc80c7740238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.184533:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846073.184545:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846073.184550:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d52f36d3/0x1345bc80c7740238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.184557:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824e00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846073.184562:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52f36d3/0x1345bc80c7740238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.184570:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d52f36d3/0x1345bc80c7740238 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.184585:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d52f36d3/0x1345bc80c7740238 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.184593:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52f36d3/0x1345bc80c7740238 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.184619:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.184621:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.184624:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.185454:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.185462:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023df5b10/0x1345bc80c774023f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.185473:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.185477:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.185482:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023df5b10/0x1345bc80c774023f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.185492:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023df5b10/0x1345bc80c774023f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.185500:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023df5b10/0x1345bc80c774023f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.185519:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023df5b10/0x1345bc80c774023f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.185534:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846073.185548:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846073.185552:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023df5b10/0x1345bc80c774023f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.185571:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824200 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846073.185574:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023df5b10/0x1345bc80c774023f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.185583:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023df5b10/0x1345bc80c774023f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.185599:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023df5b10/0x1345bc80c774023f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.185606:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023df5b10/0x1345bc80c774023f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.185620:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.185622:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.185624:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846073.185821:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14433:x1875740739070720:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14414us (14506us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788846073.185831:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788846073.185885:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14433:1875740739070720:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788846073.185901:0:14433:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00002000:00010000:1.0:1788846073.186067:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.186074:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d60261/0x1345bc80c7740246 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186084:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.186087:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.186092:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016d60261/0x1345bc80c7740246 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186101:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016d60261/0x1345bc80c7740246 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186114:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016d60261/0x1345bc80c7740246 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186121:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016d60261/0x1345bc80c7740246 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186133:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846073.186242:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846073.186246:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016d60261/0x1345bc80c7740246 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186253:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825c00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846073.186256:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d60261/0x1345bc80c7740246 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186263:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016d60261/0x1345bc80c7740246 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186274:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016d60261/0x1345bc80c7740246 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186280:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016d60261/0x1345bc80c7740246 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186292:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.186299:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.186301:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.186817:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.186824:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba08cb9/0x1345bc80c774024d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186833:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.186836:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.186840:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ba08cb9/0x1345bc80c774024d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186850:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ba08cb9/0x1345bc80c774024d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186858:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba08cb9/0x1345bc80c774024d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186866:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ba08cb9/0x1345bc80c774024d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186879:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846073.186887:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846073.186891:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ba08cb9/0x1345bc80c774024d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186898:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825a00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846073.186901:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba08cb9/0x1345bc80c774024d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186923:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba08cb9/0x1345bc80c774024d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186936:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ba08cb9/0x1345bc80c774024d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186943:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ba08cb9/0x1345bc80c774024d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.186957:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.186959:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.186960:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.188663:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.188673:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c47581a5/0x1345bc80c7740254 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.188687:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.188691:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.188696:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c47581a5/0x1345bc80c7740254 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.188708:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c47581a5/0x1345bc80c7740254 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.188717:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c47581a5/0x1345bc80c7740254 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.188731:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c47581a5/0x1345bc80c7740254 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.188758:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846073.189010:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846073.189018:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c47581a5/0x1345bc80c7740254 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.189029:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:2.0:1788846073.189035:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c47581a5/0x1345bc80c7740254 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.189060:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c47581a5/0x1345bc80c7740254 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.189102:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c47581a5/0x1345bc80c7740254 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.189111:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c47581a5/0x1345bc80c7740254 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.189136:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846073.189138:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846073.189140:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.190984:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.190995:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c88b5333/0x1345bc80c774025b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.191010:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.191014:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.191020:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c88b5333/0x1345bc80c774025b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.191033:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c88b5333/0x1345bc80c774025b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.191042:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c88b5333/0x1345bc80c774025b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.191049:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c88b5333/0x1345bc80c774025b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.191075:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.191220:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.191227:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c88b5333/0x1345bc80c774025b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.191234:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825e00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.191238:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88b5333/0x1345bc80c774025b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.191247:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88b5333/0x1345bc80c774025b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.191267:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c88b5333/0x1345bc80c774025b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.191274:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c88b5333/0x1345bc80c774025b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.191296:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.191299:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.191301:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.193434:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.193447:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72d9630/0x1345bc80c7740262 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.193468:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.193472:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.193478:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d72d9630/0x1345bc80c7740262 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.193492:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d72d9630/0x1345bc80c7740262 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.193513:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72d9630/0x1345bc80c7740262 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.193522:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d72d9630/0x1345bc80c7740262 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.193547:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788846073.193972:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.193979:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4a5ff33/0x1345bc80c7740269 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.193987:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.193990:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.193994:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4a5ff33/0x1345bc80c7740269 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.194003:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4a5ff33/0x1345bc80c7740269 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.194020:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4a5ff33/0x1345bc80c7740269 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.194026:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4a5ff33/0x1345bc80c7740269 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.194045:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788846073.194059:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788846073.194064:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d72d9630/0x1345bc80c7740262 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.194072:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846073.194076:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72d9630/0x1345bc80c7740262 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.194080:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846073.194085:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72d9630/0x1345bc80c7740262 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.194099:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d72d9630/0x1345bc80c7740262 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.194107:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d72d9630/0x1345bc80c7740262 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.194122:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.194129:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.194130:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.195123:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.195131:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4bfb759/0x1345bc80c7740270 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.195253:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.195256:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.195261:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4bfb759/0x1345bc80c7740270 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.195272:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4bfb759/0x1345bc80c7740270 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.195281:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4bfb759/0x1345bc80c7740270 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.195288:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4bfb759/0x1345bc80c7740270 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.195314:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788846073.195828:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.195834:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd442d3/0x1345bc80c7740277 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.195843:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.195846:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.195850:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd442d3/0x1345bc80c7740277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.195865:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fd442d3/0x1345bc80c7740277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.195874:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd442d3/0x1345bc80c7740277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.195880:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fd442d3/0x1345bc80c7740277 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.195888:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788846073.195893:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788846073.195900:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4bfb759/0x1345bc80c7740270 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.195908:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824a00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:2.0:1788846073.195912:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4bfb759/0x1345bc80c7740270 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.195921:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4bfb759/0x1345bc80c7740270 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.195935:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4bfb759/0x1345bc80c7740270 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.195943:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4bfb759/0x1345bc80c7740270 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.195970:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846073.195973:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fd442d3/0x1345bc80c7740277 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.195980:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:2.0:1788846073.195983:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd442d3/0x1345bc80c7740277 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.195991:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd442d3/0x1345bc80c7740277 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.196001:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fd442d3/0x1345bc80c7740277 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.196008:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fd442d3/0x1345bc80c7740277 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846073.196020:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846073.196022:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846073.196024:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.202623:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.202636:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008377c8c0/0x1345bc80c774027e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.202653:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.202657:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.202663:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008377c8c0/0x1345bc80c774027e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.202675:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008377c8c0/0x1345bc80c774027e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.202685:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008377c8c0/0x1345bc80c774027e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.202706:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008377c8c0/0x1345bc80c774027e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.202724:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846073.202739:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846073.202744:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008377c8c0/0x1345bc80c774027e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.202752:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846073.202756:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008377c8c0/0x1345bc80c774027e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.202765:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008377c8c0/0x1345bc80c774027e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.202780:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008377c8c0/0x1345bc80c774027e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.202787:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008377c8c0/0x1345bc80c774027e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.202804:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.202806:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846073.202808:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.203290:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.203305:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbe57a67/0x1345bc80c7740285 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.203315:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.203318:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.203323:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbe57a67/0x1345bc80c7740285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.203331:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbe57a67/0x1345bc80c7740285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.203340:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbe57a67/0x1345bc80c7740285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.203346:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbe57a67/0x1345bc80c7740285 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.203360:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846073.203367:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846073.203373:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbe57a67/0x1345bc80c7740285 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.203381:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825800 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.203384:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbe57a67/0x1345bc80c7740285 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.203404:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbe57a67/0x1345bc80c7740285 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.203416:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbe57a67/0x1345bc80c7740285 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.203423:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbe57a67/0x1345bc80c7740285 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.203437:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.203439:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.203441:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846073.203736:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.203742:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035ba4f1a/0x1345bc80c774028c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.203750:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.203752:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.203756:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035ba4f1a/0x1345bc80c774028c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.203764:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035ba4f1a/0x1345bc80c774028c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.203777:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035ba4f1a/0x1345bc80c774028c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.203785:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035ba4f1a/0x1345bc80c774028c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.203806:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788846073.204214:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.204221:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e44e5902/0x1345bc80c7740293 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.204230:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.204233:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.204237:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e44e5902/0x1345bc80c7740293 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.204245:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e44e5902/0x1345bc80c7740293 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.204252:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e44e5902/0x1345bc80c7740293 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.204259:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e44e5902/0x1345bc80c7740293 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.204278:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788846073.204682:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.204688:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f11dd74/0x1345bc80c774029a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.204697:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.204700:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.204703:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f11dd74/0x1345bc80c774029a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.204712:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f11dd74/0x1345bc80c774029a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.204720:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f11dd74/0x1345bc80c774029a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.204727:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f11dd74/0x1345bc80c774029a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.204735:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788846073.205091:0:15891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788846073.205097:0:15891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017afaf21/0x1345bc80c77402a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.205105:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788846073.205114:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846073.205118:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017afaf21/0x1345bc80c77402a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.205127:0:15891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017afaf21/0x1345bc80c77402a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.205135:0:15891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017afaf21/0x1345bc80c77402a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.205142:0:15891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017afaf21/0x1345bc80c77402a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846073.205150:0:15891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788846073.205301:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788846073.205309:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035ba4f1a/0x1345bc80c774028c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205317:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824c00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.205321:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035ba4f1a/0x1345bc80c774028c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205329:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035ba4f1a/0x1345bc80c774028c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205344:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035ba4f1a/0x1345bc80c774028c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205357:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035ba4f1a/0x1345bc80c774028c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205375:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788846073.205378:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e44e5902/0x1345bc80c7740293 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205384:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02825000 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.205388:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e44e5902/0x1345bc80c7740293 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205395:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e44e5902/0x1345bc80c7740293 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205404:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e44e5902/0x1345bc80c7740293 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205411:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e44e5902/0x1345bc80c7740293 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205423:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846073.205427:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f11dd74/0x1345bc80c774029a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205432:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc5400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.205440:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f11dd74/0x1345bc80c774029a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205448:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f11dd74/0x1345bc80c774029a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205457:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f11dd74/0x1345bc80c774029a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205464:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f11dd74/0x1345bc80c774029a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205474:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846073.205477:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017afaf21/0x1345bc80c77402a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205483:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc5800 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846073.205486:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017afaf21/0x1345bc80c77402a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205492:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017afaf21/0x1345bc80c77402a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205511:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017afaf21/0x1345bc80c77402a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205518:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017afaf21/0x1345bc80c77402a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846073.205535:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846073.205536:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846073.205538:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788846073.205939:0:15891:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1788846073.206027:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14435:x1875740739070592:12345-0@lo:5:osp-pre-1-0.0 Request processed in 69442us (76753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846073.206036:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788846073.206088:0:14435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14435:1875740739070592:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788846073.206104:0:14435:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788846073.206296:0:14435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d674700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14435:1875740739070848:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788846073.206331:0:14435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846073.206367:0:14435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200aef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788846073.206386:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739070848 00000100:00100000:1.0:1788846073.206392:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739070848 00000100:00100000:1.0:1788846073.206433:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788846073.206443:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14435:x1875740739070848:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788846073.206493:0:15096:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1788846073.207300:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.207309:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4a5ff33/0x1345bc80c7740269 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.207319:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c02824600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846073.207324:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4a5ff33/0x1345bc80c7740269 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.207333:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4a5ff33/0x1345bc80c7740269 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.207350:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4a5ff33/0x1345bc80c7740269 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.207368:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4a5ff33/0x1345bc80c7740269 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846073.207386:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.207388:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.207390:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.207395:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.207397:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788846073.209470:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788846073.214002:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14435:x1875740739070848:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7555us (7664us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788846073.214014:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788846073.214104:0:14435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d674700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14435:1875740739070848:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788846073.214119:0:14435:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788846073.318294:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788846074.150482:0:14407:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788846074.150489:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a0c3d38b000 from 8 10000000:01000000:3.0:1788846074.150494:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788846074.150554:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c77402a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846074.150566:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c77402a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846074.150578:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c77402a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846074.150602:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739070976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788846074.150662:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846074.150754:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c263e53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846074.150850:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739070976 00000100:00100000:0.0:1788846074.150857:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739070976 00000100:00100000:0.0:1788846074.150942:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788846074.150951:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:14407:x1875740739070976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788846074.150965:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846074.150979:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c3e0c4a00/0x1345bc80c77402af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c77402a8 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846074.151000:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3e0c4a00/0x1345bc80c77402af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c77402a8 expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846074.151010:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c3e0c4a00/0x1345bc80c77402af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c77402a8 expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846074.151018:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3e0c4a00, rc 0) 00000100:00100000:0.0:1788846074.151077:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:14407:x1875740739070976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846074.151083:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788846074.151150:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739070976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846074.151180:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c77402a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77402af expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846074.151189:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c77402a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c77402af expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846074.151245:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d529500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739071104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788846074.151277:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846074.151438:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c263e53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846074.151468:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739071104 00000100:00100000:2.0:1788846074.151473:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739071104 00000100:00100000:2.0:1788846074.151494:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788846074.151658:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04825450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:14407:x1875740739071104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788846074.151672:0:14404:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788846074.151692:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788846074.151695:0:14404:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788846074.151777:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04825450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:14407:x1875740739071104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846074.151785:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788846074.151817:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d529500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739071104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788846074.151873:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788846074.151880:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c77402a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77402af expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846074.151888:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c01475e00/0x1345bc80c77402a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c77402af expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846074.342929:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846075.366344:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788846075.946508:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788846075.946553:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788846076.396321:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846077.414505:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788846077.435406:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788846077.435423:0:7645:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:02000400:1.0:1788846077.441616:0:16167:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788846078.383202:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739071360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788846078.383268:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846078.383320:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739071872:0@lo:400:kworker.0 00000100:00100000:1.0:1788846078.383345:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846078.383370:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788846078.383376:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ac7e2af-29a9-4384-8c8c-a41d76049816:3309:1875740739071488:0@lo:400:kworker.0 00000100:00100000:1.0:1788846078.383403:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846078.383425:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739072000:0@lo:400:kworker.0 00000100:00100000:1.0:1788846078.383448:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846078.383488:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739071616:0@lo:400:kworker.0 00000100:00100000:1.0:1788846078.383525:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846078.383550:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739072128:0@lo:400:kworker.0 00000100:00100000:1.0:1788846078.383572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846078.383591:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788846078.383597:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739071232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846078.383620:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846078.383634:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739071360 00000100:00100000:1.0:1788846078.383637:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739071744:0@lo:400:kworker.0 00000100:00100000:2.0:1788846078.383643:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739071360 00000100:00100000:1.0:1788846078.383679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846078.383693:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739071232 00000100:00100000:2.0:1788846078.383699:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739071232 00000100:00100000:1.0:1788846078.383717:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739071872 00000100:00100000:1.0:1788846078.383722:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739071872 00000100:00100000:2.0:1788846078.383724:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788846078.383736:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d677800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739071360:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788846078.383756:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739072000 00000100:00100000:1.0:1788846078.383760:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739072000 00002000:00000024:2.0:1788846078.383769:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788846078.383779:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739072128 00000100:00100000:1.0:1788846078.383782:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739072128 00000100:00100000:1.0:1788846078.383800:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788846078.383809:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739071872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846078.383826:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d677800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739071360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846078.383834:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788846078.383849:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739071872:12345-0@lo:400:kworker.0 Request processed in 41us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846078.383856:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788846078.383870:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788846078.383876:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739072000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846078.383903:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739072000:12345-0@lo:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846078.383909:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788846078.383919:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788846078.383925:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739072128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846078.383955:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739072128:12345-0@lo:400:kworker.0 Request processed in 30us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846078.383961:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788846078.383978:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739071488 00000100:00100000:1.0:1788846078.383981:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739071488 00000100:00100000:1.0:1788846078.384004:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788846078.384010:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:3309:x1875740739071488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846078.384037:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788846078.384050:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:3309:x1875740739071488:12345-0@lo:400:kworker.0 Request processed in 37us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846078.384051:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739071232:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846078.384065:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00002000:00000024:2.0:1788846078.384070:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788846078.384107:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788846078.384112:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788846078.384114:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846078.384123:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739071616 00000100:00100000:1.0:1788846078.384126:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739071616 00000100:00100000:1.0:1788846078.384149:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739071744 00000100:00100000:1.0:1788846078.384168:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739071744 00000100:00100000:1.0:1788846078.384187:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788846078.384194:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d675c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739071616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846078.384307:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875740739071232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 261us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846078.384321:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788846078.384442:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788846078.384452:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739071744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846078.386825:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d675c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739071616:12345-0@lo:400:kworker.0 Request processed in 2623us (3291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846078.386837:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788846078.386896:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788846078.386921:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739071232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846078.386933:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788846078.386943:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739071616:0@lo:400:kworker.0 00010000:00080000:1.0:1788846078.386955:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d676300 x1875740739072128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846078.386965:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739072128:0@lo:400:kworker.0 00000100:00100000:1.0:1788846078.386995:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d675500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ac7e2af-29a9-4384-8c8c-a41d76049816:3309:1875740739071488:0@lo:400:kworker.0 00010000:00080000:1.0:1788846078.387007:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d674e00 x1875740739072000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846078.387016:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739072000:0@lo:400:kworker.0 00000100:00100000:1.0:1788846078.387052:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739071360:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788846078.387062:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a0c3d675180 x1875740739071872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846078.387070:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d675180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739071872:0@lo:400:kworker.0 00000100:00100000:0.0:1788846078.388137:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739071744:12345-0@lo:400:kworker.0 Request processed in 3685us (4456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846078.388147:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788846078.388237:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739071744:0@lo:400:kworker.0 00010000:00010000:0.0:1788846078.438420:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846079.068899:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846079.068983:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720207872 00000100:00100000:1.0:1788846079.068993:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720207872 00000100:00100000:1.0:1788846079.069039:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:1.0:1788846079.069046:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2350:x1875740720207872:12345-192.168.206.48@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788846079.069071:0:14403:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 680da2ee-d974-4c5c-a1a4-be7fb770e480@192.168.206.48@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:1.0:1788846079.069109:0:14403:0:(genops.c:1385:class_connect()) connect: client 680da2ee-d974-4c5c-a1a4-be7fb770e480, cookie 0x1345bc80c77402b6 00000100:00080000:1.0:1788846079.069467:0:14403:0:(import.c:65:import_set_state_nolock()) ffff9a0c417e2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846079.069545:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+5:2350:x1875740720207872:12345-192.168.206.48@tcp:250:mount.lustre.0 Request processed in 497us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846079.069553:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:1.0:1788846079.071952:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846079.072083:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720208000 00000100:00100000:2.0:1788846079.072093:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720208000 00000100:00100000:2.0:1788846079.072314:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:2.0:1788846079.072325:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+5:13742:x1875740720208000:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788846079.072340:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846079.072357:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0b04375e00/0x1345bc80c77402bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d0b5 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846079.072385:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0b04375e00/0x1345bc80c77402bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0b5 expref: 6 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846079.072396:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0b04375e00/0x1345bc80c77402bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0b5 expref: 6 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846079.072405:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04375e00, rc 0) 00000100:00100000:2.0:1788846079.072463:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+6:13742:x1875740720208000:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 140us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846079.072479:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:2.0:1788846079.074219:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846079.074302:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720208128 00000100:00100000:1.0:1788846079.074311:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720208128 00000100:00100000:1.0:1788846079.074365:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:1.0:1788846079.074375:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+6:13742:x1875740720208128:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788846079.074671:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+6:13742:x1875740720208128:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 297us (458us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788846079.074680:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:3.0:1788846079.076667:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846079.076737:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720208256 00000100:00100000:2.0:1788846079.076746:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720208256 00000100:00100000:2.0:1788846079.076798:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:2.0:1788846079.076808:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+6:13742:x1875740720208256:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788846079.076822:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846079.076851:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0b04375600/0x1345bc80c77402c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d0bc expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846079.076879:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0b04375600/0x1345bc80c77402c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0bc expref: 7 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846079.076890:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0b04375600/0x1345bc80c77402c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0bc expref: 7 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846079.076898:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04375600, rc 0) 00000100:00100000:2.0:1788846079.076951:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+7:13742:x1875740720208256:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 145us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846079.076958:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:0.0:1788846079.079376:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846079.081299:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720208384 00000100:00100000:2.0:1788846079.081312:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720208384 00000100:00100000:2.0:1788846079.081368:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:2.0:1788846079.081378:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+7:13742:x1875740720208384:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788846079.082573:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+8:13742:x1875740720208384:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 1190us (3463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846079.082584:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:2.0:1788846079.090688:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846079.090776:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720208512 00000100:00100000:1.0:1788846079.090786:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720208512 00000100:00100000:1.0:1788846079.090857:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:1.0:1788846079.090868:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+8:13742:x1875740720208512:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788846079.091219:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+8:13742:x1875740720208512:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 353us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846079.091228:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:0.0:1788846079.098553:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846079.098903:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720208640 00000100:00100000:3.0:1788846079.098913:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720208640 00000100:00100000:3.0:1788846079.099022:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:3.0:1788846079.099034:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+8:13760:x1875740720208640:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788846079.099417:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+8:13760:x1875740720208640:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 385us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846079.099426:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:2.0:1788846079.110306:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846079.111528:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720208768 00000100:00100000:0.0:1788846079.111539:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720208768 00000100:00100000:0.0:1788846079.111602:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:0.0:1788846079.111612:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+8:13760:x1875740720208768:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788846079.111902:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+8:13760:x1875740720208768:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 290us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846079.111911:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:2.0:1788846079.115287:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846079.116633:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720208896 00000100:00100000:3.0:1788846079.116645:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720208896 00000100:00100000:3.0:1788846079.116707:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:3.0:1788846079.116716:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+8:13742:x1875740720208896:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788846079.116731:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846079.116747:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475200/0x1345bc80c77402cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d0e6 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846079.116776:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475200/0x1345bc80c77402cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0e6 expref: 9 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846079.116805:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475200/0x1345bc80c77402cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0e6 expref: 9 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846079.116815:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475200, rc 0) 00000100:00100000:3.0:1788846079.116878:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+9:13742:x1875740720208896:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 163us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846079.116886:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:3.0:1788846079.124369:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846079.124484:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720209024 00000100:00100000:1.0:1788846079.124494:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720209024 00000100:00100000:1.0:1788846079.124555:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:1.0:1788846079.124565:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+9:13742:x1875740720209024:12345-192.168.206.48@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788846079.124589:0:14403:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788846079.124611:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788846079.124615:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788846079.124619:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788846079.124621:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788846079.127104:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+9:13742:x1875740720209024:12345-192.168.206.48@tcp:256:mount.lustre.0 Request processed in 2529us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846079.127844:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:2.0:1788846079.130836:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846079.134520:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720209152 00000100:00100000:0.0:1788846079.134535:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720209152 00000100:00100000:0.0:1788846079.134603:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:0.0:1788846079.134614:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+9:13742:x1875740720209152:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788846079.134628:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846079.134645:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c3e0c4200/0x1345bc80c77402d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d0ed expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846079.134688:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c3e0c4200/0x1345bc80c77402d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0ed expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846079.134700:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c3e0c4200/0x1345bc80c77402d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0ed expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846079.134710:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3e0c4200, rc 0) 00000100:00100000:0.0:1788846079.134786:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+10:13742:x1875740720209152:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 173us (3958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846079.134794:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:3.0:1788846079.139720:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846079.141315:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720209280 00000100:00100000:1.0:1788846079.141328:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720209280 00000100:00100000:1.0:1788846079.141394:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:1.0:1788846079.141403:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+10:13742:x1875740720209280:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788846079.141699:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+10:13742:x1875740720209280:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 295us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846079.141707:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:2.0:1788846079.144483:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846079.144609:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720209408 00000100:00100000:3.0:1788846079.144619:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720209408 00000100:00100000:3.0:1788846079.144672:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:3.0:1788846079.144682:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+10:13742:x1875740720209408:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788846079.145822:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+10:13742:x1875740720209408:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 1136us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846079.145834:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:2.0:1788846079.153962:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846079.154076:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720209536 00000100:00100000:0.0:1788846079.154086:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720209536 00000100:00100000:0.0:1788846079.154183:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:0.0:1788846079.154195:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+10:13764:x1875740720209536:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788846079.154454:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+10:13764:x1875740720209536:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 261us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846079.154463:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:1.0:1788846079.164843:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846079.164963:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720209664 00000100:00100000:3.0:1788846079.164974:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720209664 00000100:00100000:3.0:1788846079.165031:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:3.0:1788846079.165041:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+10:13764:x1875740720209664:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788846079.165308:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+10:13764:x1875740720209664:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 267us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846079.165317:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:2.0:1788846079.171096:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846079.175239:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720209792 00000100:00100000:1.0:1788846079.175270:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720209792 00000100:00100000:1.0:1788846079.175333:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1788846079.175341:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2350:x1875740720209792:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788846079.175369:0:15118:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3dddf1bf-7100-425c-add4-3eaf629f103f@192.168.206.48@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:1.0:1788846079.175411:0:15118:0:(genops.c:1385:class_connect()) connect: client 3dddf1bf-7100-425c-add4-3eaf629f103f, cookie 0x1345bc80c77402d9 00000004:00100000:1.0:1788846079.175437:0:15118:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788846079.175442:0:15118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788846079.213300:0:15118:0:(import.c:65:import_set_state_nolock()) ffff9a0b05f17000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846079.213370:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+6:2350:x1875740720209792:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 38028us (42281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846079.213380:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:2.0:1788846079.216050:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846079.216248:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720209920 00000100:00100000:1.0:1788846079.216256:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720209920 00000100:00100000:1.0:1788846079.216317:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1788846079.216325:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+6:0:x1875740720209920:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788846079.216359:0:14412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788846079.216431:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+6:0:x1875740720209920:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 106us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846079.216438:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00080000:2.0:1788846079.216772:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846079.217210:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846079.217293:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720210048 00000100:00100000:2.0:1788846079.217299:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720210048 00000100:00100000:2.0:1788846079.217336:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1788846079.217344:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+6:13742:x1875740720210048:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788846079.217363:0:14410:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788846079.217408:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+6:13742:x1875740720210048:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 64us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846079.217415:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1788846079.218976:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846079.219191:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720210176 00000100:00100000:1.0:1788846079.219199:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720210176 00000100:00100000:1.0:1788846079.219245:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1788846079.219253:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+6:13742:x1875740720210176:12345-192.168.206.48@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788846079.219323:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+6:13742:x1875740720210176:12345-192.168.206.48@tcp:40:mount.lustre.0 Request processed in 70us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846079.219330:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1788846079.222708:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846079.222807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846079.222868:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846079.222900:0:15891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720210304 00000100:00100000:2.0:1788846079.222910:0:15891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720210304 00000100:00100000:2.0:1788846079.222959:0:15891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720210432 00000100:00100000:2.0:1788846079.222963:0:15891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720210432 00000100:00100000:2.0:1788846079.222981:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1788846079.222989:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1875740720210304:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788846079.223028:0:15891:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3dddf1bf-7100-425c-add4-3eaf629f103f@192.168.206.48@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:2.0:1788846079.223066:0:15891:0:(genops.c:1385:class_connect()) connect: client 3dddf1bf-7100-425c-add4-3eaf629f103f, cookie 0x1345bc80c77402e0 00002000:00100000:2.0:1788846079.223083:0:15891:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3dddf1bf-7100-425c-add4-3eaf629f103f/ffff9a0b05f10800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788846079.223094:0:15891:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788846079.223185:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1788846079.223192:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875740720210432:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788846079.223211:0:15096:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3dddf1bf-7100-425c-add4-3eaf629f103f@192.168.206.48@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:3.0:1788846079.223234:0:15096:0:(genops.c:1385:class_connect()) connect: client 3dddf1bf-7100-425c-add4-3eaf629f103f, cookie 0x1345bc80c77402e7 00002000:00100000:3.0:1788846079.223241:0:15096:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3dddf1bf-7100-425c-add4-3eaf629f103f/ffff9a0b0573b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788846079.223247:0:15096:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788846079.223534:0:15891:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788846079.223564:0:15891:0:(import.c:65:import_set_state_nolock()) ffff9a0b05f16000 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1788846079.223596:0:15096:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788846079.223617:0:15096:0:(import.c:65:import_set_state_nolock()) ffff9a0b0573c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846079.223631:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+6:2350:x1875740720210304:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 640us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846079.223640:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:3.0:1788846079.223650:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+6:2350:x1875740720210432:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 455us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846079.223659:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1788846079.224200:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720210560 00000100:00100000:1.0:1788846079.224207:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720210560 00000100:00100000:1.0:1788846079.224239:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1788846079.224258:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+6:13742:x1875740720210560:12345-192.168.206.48@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788846079.226305:0:14413:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1991us 00000004:00200000:3.0:1788846079.238283:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788846079.238399:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+6:13742:x1875740720210560:12345-192.168.206.48@tcp:33:mount.lustre.0 Request processed in 14137us (15694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846079.238412:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:3.0:1788846079.384429:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846079.384577:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720210688 00000100:00100000:2.0:1788846079.384600:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720210688 00000100:00100000:2.0:1788846079.384751:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1788846079.384762:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+6:13785:x1875740720210688:12345-192.168.206.48@tcp:101:mkdir.0 00010000:00010000:2.0:1788846079.384782:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846079.384805:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c77402ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d117 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846079.384865:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374600/0x1345bc80c77402f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846079.384878:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374600/0x1345bc80c77402f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846079.384892:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374600/0x1345bc80c77402f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846079.384920:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788846079.384924:0:14410:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788846079.384964:0:14410:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374600/0x1345bc80c77402f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846079.384988:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c77402ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d117 expref: 8 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846079.385005:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374600/0x1345bc80c77402f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d117 expref: 7 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846079.385014:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f800) 00010000:00010000:2.0:1788846079.385017:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846079.385020:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04374600, rc 0) 00000100:00100000:2.0:1788846079.385082:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+7:13785:x1875740720210688:12345-192.168.206.48@tcp:101:mkdir.0 Request processed in 322us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846079.385089:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00010000:00010000:1.0:1788846079.462302:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846080.488112:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788846080.742840:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1788846080.973400:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3dddf1bf-7100-425c-add4-3eaf629f103f 00000100:00100000:0.0:1788846081.165836:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846081.165934:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720210816 00000100:00100000:1.0:1788846081.165944:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720210816 00000100:00100000:1.0:1788846081.166025:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:1.0:1788846081.166035:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+7:13837:x1875740720210816:12345-192.168.206.48@tcp:41:lfs.0 00000004:00000024:1.0:1788846081.166080:0:14412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788846081.166720:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+7:13837:x1875740720210816:12345-192.168.206.48@tcp:41:lfs.0 Request processed in 683us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846081.166729:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00080000:2.0:1788846081.166803:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788846081.170785:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846081.172930:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720210944 00000100:00100000:2.0:1788846081.172942:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720210944 00000100:00100000:3.0:1788846081.173500:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00080000:2.0:1788846081.173642:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846081.173731:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3dddf1bf-7100-425c-add4-3eaf629f103f+5:13837:x1875740720210944:12345-192.168.206.48@tcp:13:lfs.0 00002000:00000024:3.0:1788846081.173766:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788846081.173855:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3dddf1bf-7100-425c-add4-3eaf629f103f+5:13837:x1875740720210944:12345-192.168.206.48@tcp:13:lfs.0 Request processed in 128us (3078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846081.177962:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:2.0:1788846081.178300:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846081.178387:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720211072 00000100:00100000:0.0:1788846081.178397:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720211072 00000100:00100000:0.0:1788846081.178510:0:15098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:0.0:1788846081.178520:0:15098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3dddf1bf-7100-425c-add4-3eaf629f103f+6:13837:x1875740720211072:12345-192.168.206.48@tcp:13:lfs.0 00002000:00000024:0.0:1788846081.178565:0:15098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788846081.178647:0:15098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3dddf1bf-7100-425c-add4-3eaf629f103f+6:13837:x1875740720211072:12345-192.168.206.48@tcp:13:lfs.0 Request processed in 128us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846081.178654:0:15098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00080000:2.0:1788846081.178972:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788846081.348813:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846081.348898:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720211200 00000100:00100000:1.0:1788846081.348908:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720211200 00000100:00100000:1.0:1788846081.349027:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00100000:1.0:1788846081.349038:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+10:13872:x1875740720211200:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788846081.349054:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846081.349072:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c34bc4200/0x1345bc80c77402fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d11e expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846081.349102:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c34bc4200/0x1345bc80c77402fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d11e expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846081.349113:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c34bc4200/0x1345bc80c77402fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d11e expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846081.349122:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34bc4200, rc 0) 00000100:00100000:1.0:1788846081.349220:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+11:13872:x1875740720211200:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 184us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846081.349252:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00100000:1.0:1788846081.367625:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846081.367716:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720211328 00000100:00100000:0.0:1788846081.367726:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720211328 00000100:00100000:0.0:1788846081.367776:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:0.0:1788846081.367786:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d8a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+11:13872:x1875740720211328:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788846081.368062:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d8a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+11:13872:x1875740720211328:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 276us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846081.368071:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:0.0:1788846081.370842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846081.370929:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720211456 00000100:00100000:1.0:1788846081.370937:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720211456 00000100:00100000:1.0:1788846081.370986:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:1.0:1788846081.370996:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+11:13872:x1875740720211456:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788846081.372387:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+11:13872:x1875740720211456:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 1385us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846081.372399:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:1.0:1788846081.377344:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846081.378657:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720211584 00000100:00100000:3.0:1788846081.378669:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720211584 00000100:00100000:3.0:1788846081.378732:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 92 00000100:00100000:3.0:1788846081.378741:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+11:13876:x1875740720211584:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788846081.379100:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+11:13876:x1875740720211584:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 359us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846081.379346:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 92 00000100:00100000:2.0:1788846081.393584:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846081.395923:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720211712 00000100:00100000:1.0:1788846081.395936:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720211712 00000100:00100000:1.0:1788846081.396366:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:1.0:1788846081.396381:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+11:13876:x1875740720211712:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788846081.396888:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+11:13876:x1875740720211712:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 510us (3312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846081.396896:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:0.0:1788846081.406372:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846081.406816:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720211840 00000100:00100000:3.0:1788846081.406826:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720211840 00000100:00100000:3.0:1788846081.406882:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00100000:3.0:1788846081.406892:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+11:13872:x1875740720211840:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788846081.406906:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846081.406922:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01475400/0x1345bc80c7740303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d148 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846081.406950:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475400/0x1345bc80c7740303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d148 expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846081.406961:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01475400/0x1345bc80c7740303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d148 expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846081.406970:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01475400, rc 0) 00000100:00100000:3.0:1788846081.407038:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+12:13872:x1875740720211840:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 147us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846081.407045:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00100000:2.0:1788846081.416557:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846081.416697:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720211968 00000100:00100000:1.0:1788846081.416707:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720211968 00000100:00100000:1.0:1788846081.416756:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 95 00000100:00100000:1.0:1788846081.416767:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+12:13872:x1875740720211968:12345-192.168.206.48@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788846081.416791:0:14403:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788846081.416811:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788846081.416815:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788846081.416817:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788846081.416825:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788846081.419702:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+12:13872:x1875740720211968:12345-192.168.206.48@tcp:256:mount.lustre.0 Request processed in 2926us (3142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846081.419716:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 95 00000100:00100000:0.0:1788846081.422796:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846081.422907:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720212096 00000100:00100000:2.0:1788846081.422916:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720212096 00000100:00100000:2.0:1788846081.423013:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 96 00000100:00100000:2.0:1788846081.423024:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+12:13872:x1875740720212096:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788846081.423040:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846081.423056:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0b04375000/0x1345bc80c774030a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d14f expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.423084:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0b04375000/0x1345bc80c774030a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d14f expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.423094:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0b04375000/0x1345bc80c774030a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d14f expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.423103:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04375000, rc 0) 00000100:00100000:2.0:1788846081.423208:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13872:x1875740720212096:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 186us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846081.423242:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 96 00000100:00100000:1.0:1788846081.425621:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846081.425756:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720212224 00000100:00100000:3.0:1788846081.425766:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720212224 00000100:00100000:3.0:1788846081.425828:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:3.0:1788846081.425838:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c05fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13872:x1875740720212224:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788846081.426471:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c05fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13872:x1875740720212224:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 623us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846081.426480:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:1.0:1788846081.428770:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846081.428851:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720212352 00000100:00100000:3.0:1788846081.428861:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720212352 00000100:00100000:3.0:1788846081.428940:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 98 00000100:00100000:3.0:1788846081.428949:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0431b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13872:x1875740720212352:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788846081.429227:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0431b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13872:x1875740720212352:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 273us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846081.429244:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 98 00000100:00100000:0.0:1788846081.433749:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846081.433951:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720212480 00000100:00100000:2.0:1788846081.433961:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720212480 00000100:00100000:2.0:1788846081.434018:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:2.0:1788846081.434028:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13881:x1875740720212480:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788846081.434519:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13881:x1875740720212480:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 490us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846081.434528:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:2.0:1788846081.448340:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846081.448478:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720212608 00000100:00100000:3.0:1788846081.448487:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720212608 00000100:00100000:3.0:1788846081.448539:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 100 00000100:00100000:3.0:1788846081.448549:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0431a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13881:x1875740720212608:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788846081.448784:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0431a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13881:x1875740720212608:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 235us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846081.448792:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 100 00000100:00100000:1.0:1788846081.455437:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846081.455485:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846081.455523:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846081.455554:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846081.455589:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720213376 00000100:00100000:1.0:1788846081.455599:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720213376 00000100:00100000:1.0:1788846081.455639:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720213248 00000100:00100000:1.0:1788846081.455641:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720213248 00000100:00100000:1.0:1788846081.455659:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1788846081.455668:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+6:2352:x1875740720213376:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788846081.455732:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+6:2352:x1875740720213376:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 65us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846081.455740:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1788846081.455755:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1788846081.455762:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+5:2352:x1875740720213248:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788846081.455785:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+5:2352:x1875740720213248:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 24us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846081.455791:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1788846081.455928:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720212736 00000100:00100000:3.0:1788846081.455933:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720212736 00000100:00100000:3.0:1788846081.455962:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720213120 00000100:00100000:3.0:1788846081.455964:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720213120 00000100:00100000:3.0:1788846081.455985:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1788846081.455991:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+7:2352:x1875740720213120:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788846081.456032:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+7:2352:x1875740720213120:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 41us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846081.456039:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1788846081.456053:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:3.0:1788846081.456057:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1875740720212736:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788846081.456079:0:14410:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1722eb5e-5eb5-4468-911e-fc617f4d1a7f@192.168.206.48@tcp t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:3.0:1788846081.456112:0:14410:0:(genops.c:1385:class_connect()) connect: client 1722eb5e-5eb5-4468-911e-fc617f4d1a7f, cookie 0x1345bc80c7740311 00000004:00100000:3.0:1788846081.456144:0:14410:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788846081.456298:0:14410:0:(import.c:65:import_set_state_nolock()) ffff9a0b05738800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788846081.456331:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:2350:x1875740720212736:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 272us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846081.456336:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:0.0:1788846081.463982:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846081.464016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846081.464103:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720212992 00000100:00100000:1.0:1788846081.464121:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720212992 00000100:00100000:1.0:1788846081.464218:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720212864 00000100:00100000:1.0:1788846081.464235:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720212864 00000100:00100000:1.0:1788846081.464261:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:1.0:1788846081.464271:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+7:13872:x1875740720212992:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788846081.464301:0:14411:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788846081.464366:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+7:13872:x1875740720212992:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 96us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846081.464374:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:1.0:1788846081.464390:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:1.0:1788846081.464396:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:0:x1875740720212864:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788846081.464405:0:14411:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788846081.464426:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:0:x1875740720212864:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 31us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846081.464431:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00080000:2.0:1788846081.464700:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846081.473654:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846081.474286:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720213504 00000100:00100000:1.0:1788846081.474297:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720213504 00000100:00100000:1.0:1788846081.474357:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1788846081.474367:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:13872:x1875740720213504:12345-192.168.206.48@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788846081.474644:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:13872:x1875740720213504:12345-192.168.206.48@tcp:40:mount.lustre.0 Request processed in 278us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846081.474652:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1788846081.480702:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846081.480742:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846081.480777:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846081.480816:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720213632 00000100:00100000:3.0:1788846081.480828:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720213632 00000100:00100000:2.0:1788846081.480907:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720213888 00000100:00100000:2.0:1788846081.480912:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720213888 00000100:00100000:3.0:1788846081.480934:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720213760 00000100:00100000:3.0:1788846081.480940:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720213760 00000100:00100000:2.0:1788846081.480953:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:2.0:1788846081.480964:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:13872:x1875740720213888:12345-192.168.206.48@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788846081.481035:0:14414:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788846081.481102:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:13872:x1875740720213888:12345-192.168.206.48@tcp:33:mount.lustre.0 Request processed in 140us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846081.481109:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:0.0:1788846081.481865:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:0.0:1788846081.481873:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1875740720213632:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788846081.481899:0:15891:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1722eb5e-5eb5-4468-911e-fc617f4d1a7f@192.168.206.48@tcp t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:0.0:1788846081.481925:0:15891:0:(genops.c:1385:class_connect()) connect: client 1722eb5e-5eb5-4468-911e-fc617f4d1a7f, cookie 0x1345bc80c7740318 00002000:00100000:0.0:1788846081.481936:0:15891:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1722eb5e-5eb5-4468-911e-fc617f4d1a7f/ffff9a0b06a02800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788846081.481946:0:15891:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788846081.482751:0:15891:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788846081.482794:0:15891:0:(import.c:65:import_set_state_nolock()) ffff9a0b06a01800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788846081.483150:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:2350:x1875740720213632:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 1275us (2405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846081.483183:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:0.0:1788846081.483211:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:0.0:1788846081.483217:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1875740720213760:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788846081.483238:0:15891:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1722eb5e-5eb5-4468-911e-fc617f4d1a7f@192.168.206.48@tcp t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:0.0:1788846081.483261:0:15891:0:(genops.c:1385:class_connect()) connect: client 1722eb5e-5eb5-4468-911e-fc617f4d1a7f, cookie 0x1345bc80c774031f 00002000:00100000:0.0:1788846081.483270:0:15891:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1722eb5e-5eb5-4468-911e-fc617f4d1a7f/ffff9a0b06a07000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788846081.483278:0:15891:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788846081.483337:0:15891:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788846081.483355:0:15891:0:(import.c:65:import_set_state_nolock()) ffff9a0b06a04800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788846081.483381:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:2350:x1875740720213760:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 163us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846081.483388:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00010000:00010000:0.0:1788846081.511698:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846081.643487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846081.643591:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720214016 00000100:00100000:2.0:1788846081.643601:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720214016 00000100:00100000:2.0:1788846081.643656:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:2.0:1788846081.643666:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:13902:x1875740720214016:12345-192.168.206.48@tcp:101:mkdir.0 00010000:00010000:2.0:1788846081.643684:0:15118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846081.643703:0:15118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374200/0x1345bc80c7740326 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d179 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.643772:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c774032d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.643786:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c774032d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.643797:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c774032d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846081.643828:0:15118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788846081.643831:0:15118:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788846081.643848:0:15118:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c774032d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.643871:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374200/0x1345bc80c7740326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d179 expref: 8 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.643887:0:15118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c774032d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d179 expref: 7 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.643895:0:15118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f800) 00010000:00010000:2.0:1788846081.643898:0:15118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846081.643901:0:15118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04374800, rc 0) 00000100:00100000:2.0:1788846081.643963:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+7:13902:x1875740720214016:12345-192.168.206.48@tcp:101:mkdir.0 Request processed in 298us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846081.643970:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000001:00100000:2.0:1788846082.499361:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1722eb5e-5eb5-4468-911e-fc617f4d1a7f 00000001:00100000:2.0:1788846082.499376:0:7645:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3dddf1bf-7100-425c-add4-3eaf629f103f 00010000:00010000:1.0:1788846082.534331:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846083.494357:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3ac7e2af-29a9-4384-8c8c-a41d76049816:3308:1875740739072256:0@lo:400:kworker.0 00000100:00100000:0.0:1788846083.494366:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739072384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788846083.494488:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739072512:0@lo:400:kworker.0 00000100:00100000:3.0:1788846083.494512:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739072640:0@lo:400:kworker.0 00000100:00100000:2.0:1788846083.494523:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846083.494556:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846083.494575:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875740739073024:0@lo:400:kworker.0 00000100:00100000:3.0:1788846083.494596:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739073152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788846083.494606:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846083.494637:0:15891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739072512 00000100:00100000:2.0:1788846083.494638:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788846083.494645:0:15891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739072512 00000100:00100000:2.0:1788846083.494646:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740739072896:0@lo:400:kworker.0 00000100:00100000:2.0:1788846083.494672:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846083.494702:0:15891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739072640 00000100:00100000:3.0:1788846083.494707:0:15891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739072640 00000100:00100000:2.0:1788846083.494712:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788846083.494724:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739072512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846083.494734:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788846083.494739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846083.494747:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739072640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846083.494798:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875740739072512:12345-0@lo:400:kworker.0 Request processed in 76us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846083.494801:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739072384 00000100:00100000:3.0:1788846083.494802:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739072640:12345-0@lo:400:kworker.0 Request processed in 57us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846083.494807:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739072384 00000100:00100000:2.0:1788846083.494812:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788846083.494823:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788846083.494844:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739073024 00000100:00100000:2.0:1788846083.494849:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739073024 00000100:00100000:2.0:1788846083.494886:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739072896 00000100:00100000:2.0:1788846083.494889:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739072896 00000100:00100000:0.0:1788846083.494918:0:15098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788846083.494927:0:15098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739072384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788846083.494952:0:15098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788846083.494991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846083.495003:0:15098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739072384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846083.495025:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740739072768:0@lo:400:kworker.0 00000100:00100000:1.0:1788846083.495050:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846083.495277:0:15098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788846083.496204:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788846083.496211:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788846083.496213:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846083.496241:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846083.496296:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739072640:0@lo:400:kworker.0 00000100:00100000:0.0:1788846083.497017:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739072384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788846083.497080:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739072256 00000100:00100000:0.0:1788846083.497086:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739072256 00000100:00100000:0.0:1788846083.497125:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788846083.497134:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:3308:x1875740739072256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846083.497208:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:3308:x1875740739072256:12345-0@lo:400:kworker.0 Request processed in 75us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846083.497215:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788846083.498406:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739072768 00000100:00100000:2.0:1788846083.498415:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739072768 00000100:00100000:2.0:1788846083.498464:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788846083.498473:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875740739073024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846083.498524:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875740739073024:12345-0@lo:400:kworker.0 Request processed in 53us (3919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846083.498530:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788846083.498546:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788846083.498552:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740739072896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846083.498577:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875740739072896:12345-0@lo:400:kworker.0 Request processed in 26us (3905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846083.498595:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788846083.498607:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788846083.498612:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740739072768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846083.498636:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875740739072768:12345-0@lo:400:kworker.0 Request processed in 24us (3586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846083.498641:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788846083.499276:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875740739072896:0@lo:400:kworker.0 00000100:00100000:1.0:1788846083.499292:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875740739072512:0@lo:400:kworker.0 00000100:00100000:1.0:1788846083.499302:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875740739073024:0@lo:400:kworker.0 00000100:00100000:3.0:1788846083.502247:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739073152 00000100:00100000:3.0:1788846083.502261:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739073152 00000100:00100000:3.0:1788846083.502334:0:15098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788846083.502345:0:15098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739073152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788846083.502384:0:15098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788846083.502535:0:15098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739073152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 191us (6293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846083.502542:0:15098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788846083.505684:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739073152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846083.505899:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875740739072768:0@lo:400:kworker.0 00000100:00100000:1.0:1788846083.505912:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3ac7e2af-29a9-4384-8c8c-a41d76049816:3308:1875740739072256:0@lo:400:kworker.0 00010000:00010000:0.0:1788846083.559359:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788846083.823370:0:16372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788846084.580911:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3dddf1bf-7100-425c-add4-3eaf629f103f 00000001:00100000:3.0:1788846084.580927:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1722eb5e-5eb5-4468-911e-fc617f4d1a7f 00010000:00010000:0.0:1788846084.585480:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846085.606316:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788846086.157620:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1722eb5e-5eb5-4468-911e-fc617f4d1a7f 00000100:00100000:0.0:1788846086.559122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846086.559197:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846086.559222:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846086.559248:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846086.559268:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846086.559289:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846086.559313:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846086.559327:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720214144 00000100:00100000:3.0:1788846086.559335:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720214144 00000100:00100000:0.0:1788846086.559342:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720214656 00000100:00100000:0.0:1788846086.559345:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720214656 00000100:00100000:0.0:1788846086.559373:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720214272 00000100:00100000:0.0:1788846086.559376:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720214272 00000100:00100000:3.0:1788846086.559378:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 102 00000100:00100000:3.0:1788846086.559386:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0431b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:2351:x1875740720214144:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788846086.559394:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:0.0:1788846086.559399:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:2351:x1875740720214656:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788846086.559461:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:2351:x1875740720214656:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 61us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846086.559483:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:0.0:1788846086.559500:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:0.0:1788846086.559507:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+6:2351:x1875740720214272:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788846086.559644:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720214400 00000100:00100000:2.0:1788846086.559648:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720214400 00000100:00100000:2.0:1788846086.559670:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720214912 00000100:00100000:2.0:1788846086.559674:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720214912 00000100:00100000:2.0:1788846086.559686:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720214528 00000100:00100000:2.0:1788846086.559688:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720214528 00000100:00100000:2.0:1788846086.559700:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720214784 00000100:00100000:2.0:1788846086.559702:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720214784 00000100:00100000:2.0:1788846086.559716:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1788846086.559723:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+5:2351:x1875740720214400:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788846086.562977:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0431b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:2351:x1875740720214144:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 3581us (3866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846086.562977:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+6:2351:x1875740720214272:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 3459us (3697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846086.562990:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 102 00000100:00100000:0.0:1788846086.562990:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:3.0:1788846086.563039:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1788846086.563051:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+5:2351:x1875740720214912:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788846086.563114:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+5:2351:x1875740720214912:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 66us (3870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846086.563121:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1788846086.563139:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:3.0:1788846086.563145:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+5:2351:x1875740720214528:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788846086.563184:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+5:2351:x1875740720214528:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 40us (3895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846086.563191:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:3.0:1788846086.563204:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1788846086.563210:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+5:2351:x1875740720214784:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1788846086.563233:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+5:2351:x1875740720214784:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 24us (3920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846086.563251:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1788846086.563260:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+5:2351:x1875740720214400:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 3537us (4062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846086.563268:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00080000:3.0:1788846086.563274:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788846086.563278:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788846086.563281:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788846086.630672:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788846086.832767:0:16523:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc35955e40 20000000:00000080:2.0:1788846086.832802:0:16523:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a0b06dba800 uarg=0000000000000000 20000000:01000000:2.0:1788846086.832838:0:16523:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788846086.832844:0:16523:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788846086.832848:0:16523:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788846086.836223:0:16524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788846086.836360:0:16523:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788846086.843131:0:16523:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788846086.849302:0:16523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.849327:0:16523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c013c9a00/0x1345bc80c774002b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c7740024 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.849335:0:16523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c01474000/0x1345bc80c7740078 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c7740071 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.849342:0:16523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c01474800/0x1345bc80c77400e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c77400e1 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.849364:0:16523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0c3e0c4200/0x1345bc80c77402d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0ed expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.849371:0:16523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0b04375000/0x1345bc80c774030a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d14f expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.849377:0:16523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.849418:0:16523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0b04375000/0x1345bc80c774030a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d14f expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.849458:0:16523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0b04375000/0x1345bc80c774030a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d14f expref: 12 pid: 14405 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846086.849474:0:16523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1875740739073280:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788846086.849572:0:16523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c3e0c4200/0x1345bc80c77402d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0ed expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.849580:0:16523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c3e0c4200/0x1345bc80c77402d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0ed expref: 12 pid: 14405 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846086.849588:0:16523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1875740739073408:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788846086.849616:0:16523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c01474800/0x1345bc80c77400e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c77400e1 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.849623:0:16523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c01474800/0x1345bc80c77400e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c77400e1 expref: 18 pid: 14404 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846086.849642:0:16523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1875740739073536:0@lo:104: 00000100:00100000:3.0:1788846086.849679:0:16523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788846086.849712:0:16523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c01474000/0x1345bc80c7740078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c7740071 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.849720:0:16523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c01474000/0x1345bc80c7740078 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c7740071 expref: 18 pid: 14404 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846086.849728:0:16523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1875740739073664:0@lo:104: 00000100:00100000:3.0:1788846086.849748:0:16523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788846086.849779:0:16523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0c013c9a00/0x1345bc80c774002b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1345bc80c7740024 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.849787:0:16523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0c013c9a00/0x1345bc80c774002b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1345bc80c7740024 expref: 18 pid: 14403 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846086.849794:0:16523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1875740739073792:0@lo:104: 00000100:00100000:0.0:1788846086.849809:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739073536 00000100:00100000:3.0:1788846086.849817:0:16523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846086.849817:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739073536 00000100:00100000:3.0:1788846086.849827:0:16523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c061e3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788846086.849860:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788846086.849871:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739073664 00000100:00100000:0.0:1788846086.849874:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739073664 00000100:00100000:0.0:1788846086.849885:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739073792 00000100:00100000:0.0:1788846086.849887:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739073792 00000100:00100000:0.0:1788846086.849899:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788846086.849906:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+5:16523:x1875740739073536:12345-0@lo:104: 00010000:00010000:0.0:1788846086.849919:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c77400e8 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.850047:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788846086.850148:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+5:16523:x1875740739073536:12345-0@lo:104: Request processed in 241us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846086.850174:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788846086.850190:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788846086.850197:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+4:16523:x1875740739073664:12345-0@lo:104: 00010000:00010000:0.0:1788846086.850211:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c7740078 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.850252:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788846086.850257:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+4:16523:x1875740739073664:12345-0@lo:104: Request processed in 62us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846086.850263:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788846086.850275:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788846086.850280:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d630050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+3:16523:x1875740739073792:12345-0@lo:104: 00010000:00010000:0.0:1788846086.850286:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c774002b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.850312:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788846086.850316:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d630050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+3:16523:x1875740739073792:12345-0@lo:104: Request processed in 37us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846086.850321:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788846086.850352:0:15892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788846086.850358:0:15892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c77400e8 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.850365:0:15892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01400 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:0.0:1788846086.850370:0:15892:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c77400e8 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.850378:0:15892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c77400e8 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788846086.850385:0:15892:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c77400e8 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846086.850396:0:15892:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788846086.850422:0:15892:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c77400e8 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.850436:0:15892:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788846086.850452:0:15892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c77400e8 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.850459:0:15892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c34a01400/0x1345bc80c77400e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c77400e8 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846086.850470:0:16523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1875740739073536:0@lo:104: 00000100:00100000:3.0:1788846086.850479:0:16523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1875740739073664:0@lo:104: 00000100:00100000:3.0:1788846086.850485:0:16523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1875740739073792:0@lo:104: 00010000:00010000:3.0:1788846086.850505:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846086.850509:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c7740078 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.850516:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c013c9c00 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:3.0:1788846086.850525:0:14398:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c7740078 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.850538:0:14398:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c7740078 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846086.850545:0:14398:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c7740078 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846086.850550:0:14398:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788846086.850550:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846086.850565:0:14398:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c7740078 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846086.850569:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3ac7e2af-29a9-4384-8c8c-a41d76049816:3308:1875740739073920:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846086.850570:0:14398:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846086.850584:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c7740078 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.850590:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c013c9c00/0x1345bc80c7740071 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c7740078 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846086.850597:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788846086.850602:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846086.850604:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846086.850605:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846086.850621:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788846086.850629:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ac7e2af-29a9-4384-8c8c-a41d76049816:3310:1875740739074048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846086.850634:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739073920 00000100:00100000:1.0:1788846086.850638:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739073920 00000100:00100000:3.0:1788846086.850651:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788846086.850654:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c01474800/0x1345bc80c77400e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c77400e1 expref: 19 pid: 14404 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846086.850672:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739074048 00000100:00100000:1.0:1788846086.850675:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739074048 00010000:00010000:1.0:1788846086.850685:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c01474000/0x1345bc80c7740078 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c7740071 expref: 20 pid: 14404 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846086.850709:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788846086.850715:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ac7e2af-29a9-4384-8c8c-a41d76049816+20:3308:x1875740739073920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788846086.850724:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846086.850729:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c01474800/0x1345bc80c77400e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c77400e1 expref: 20 pid: 14404 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.850737:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c01474800/0x1345bc80c77400e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c77400e1 expref: 20 pid: 14404 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.850750:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01474800/0x1345bc80c77400e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c77400e1 expref: 20 pid: 14404 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.850760:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846086.850777:0:14395:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788846086.850785:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788846086.850786:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:3308:x1875740739073920:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846086.850791:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788846086.850805:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788846086.850811:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:3310:x1875740739074048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788846086.850818:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846086.850822:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c01474000/0x1345bc80c7740078 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c7740071 expref: 18 pid: 14404 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.850830:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c01474000/0x1345bc80c7740078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c7740071 expref: 18 pid: 14404 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.850840:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01474000/0x1345bc80c7740078 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c7740071 expref: 18 pid: 14404 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.850858:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846086.850884:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:3310:x1875740739074048:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846086.850890:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788846086.850912:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3ac7e2af-29a9-4384-8c8c-a41d76049816:3310:1875740739074048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846086.850933:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3ac7e2af-29a9-4384-8c8c-a41d76049816:3308:1875740739073920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788846086.851031:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846086.851034:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846086.851035:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846086.855398:0:16525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846086.855404:0:16525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846086.855406:0:16525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846086.855447:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1345bc80c774002b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.855469:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01474200 already unused, calling callback (ffffffffc1ba4c20) 10000000:00010000:1.0:1788846086.855474:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1345bc80c774002b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.855484:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1345bc80c774002b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846086.855491:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1345bc80c774002b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846086.855497:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788846086.855543:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c774002b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.855550:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788846086.855574:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c774002b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.855582:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9a0c01474200/0x1345bc80c7740024 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1345bc80c774002b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.855614:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846086.855616:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846086.855618:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846086.855626:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788846086.855644:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ac7e2af-29a9-4384-8c8c-a41d76049816:3309:1875740739074176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846086.855703:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846086.855753:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739074176 00000100:00100000:1.0:1788846086.855760:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739074176 00010000:00010000:1.0:1788846086.855783:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c013c9a00/0x1345bc80c774002b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c7740024 expref: 17 pid: 14403 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846086.855812:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788846086.855820:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d3f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:3309:x1875740739074176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788846086.855832:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846086.855837:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c013c9a00/0x1345bc80c774002b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1345bc80c7740024 expref: 17 pid: 14403 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.855847:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c013c9a00/0x1345bc80c774002b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1345bc80c7740024 expref: 17 pid: 14403 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.855861:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c013c9a00/0x1345bc80c774002b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1345bc80c7740024 expref: 17 pid: 14403 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846086.855875:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846086.855910:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d3f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:3309:x1875740739074176:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846086.855917:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788846086.855997:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ac7e2af-29a9-4384-8c8c-a41d76049816:3309:1875740739074176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846086.859183:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846086.859231:0:16523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1875740739073280:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788846086.859267:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720215168 00000100:00100000:2.0:1788846086.859274:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720215168 00010000:00010000:2.0:1788846086.859311:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0c3e0c4200/0x1345bc80c77402d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0ed expref: 13 pid: 14405 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846086.859361:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1788846086.859371:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:2354:x1875740720215168:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846086.859385:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846086.859391:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0c3e0c4200/0x1345bc80c77402d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0ed expref: 13 pid: 14405 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846086.859402:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0c3e0c4200/0x1345bc80c77402d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0ed expref: 13 pid: 14405 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846086.859421:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846086.860624:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846086.860713:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720215040 00000100:00100000:0.0:1788846086.860720:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720215040 00010000:00010000:0.0:1788846086.860750:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0b04375000/0x1345bc80c774030a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d14f expref: 14 pid: 14405 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846086.860783:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:0.0:1788846086.860799:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:680da2ee-d974-4c5c-a1a4-be7fb770e480+14:2354:x1875740720215040:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846086.860809:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846086.860814:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0b04375000/0x1345bc80c774030a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d14f expref: 14 pid: 14405 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.860823:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0b04375000/0x1345bc80c774030a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d14f expref: 14 pid: 14405 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.860846:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0b04375000/0x1345bc80c774030a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d14f expref: 14 pid: 14405 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.860860:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.860867:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.860880:0:14396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.860885:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.860902:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.860908:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.860915:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c01475a00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846086.860919:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.860926:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.860934:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846086.860953:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846086.861000:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:2354:x1875740720215040:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 201us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846086.861007:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00010000:00010000:3.0:1788846086.862271:0:16523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c3e0c4200/0x1345bc80c77402d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d0ed expref: 12 pid: 14405 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846086.862306:0:16523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1875740739073408:192.168.206.48@tcp:104: 00010000:00010000:3.0:1788846086.862343:0:16523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.862352:0:16523:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.862358:0:16523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846086.862364:0:16523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0c01475a00/0x1345bc80c7740334 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846086.866628:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:680da2ee-d974-4c5c-a1a4-be7fb770e480+11:2354:x1875740720215168:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 7249us (7469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846086.866641:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00010000:00010000:3.0:1788846087.660888:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788846088.232232:0:14407:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788846088.232243:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c3d8b3800 from 10 10000000:01000000:1.0:1788846088.232250:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788846088.232313:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc4a00/0x1345bc80c774033b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.232326:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc4a00/0x1345bc80c774033b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.232340:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc4a00/0x1345bc80c774033b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846088.232372:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739074304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788846088.233215:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846088.233285:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788846088.236067:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739074304 00000100:00100000:3.0:1788846088.236085:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739074304 00000100:00100000:3.0:1788846088.236182:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788846088.236195:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+16:14407:x1875740739074304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846088.236216:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846088.236242:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01474000/0x1345bc80c7740342 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c774033b expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846088.236279:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01474000/0x1345bc80c7740342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c774033b expref: 17 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846088.236292:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01474000/0x1345bc80c7740342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c774033b expref: 17 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846088.236321:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474000, rc 0) 00000100:00100000:3.0:1788846088.236430:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:14407:x1875740739074304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (3209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846088.236438:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788846088.236526:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739074304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846088.236547:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc4a00/0x1345bc80c774033b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c7740342 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846088.236558:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc4a00/0x1345bc80c774033b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c7740342 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846088.236657:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739074432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846088.236696:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846088.236730:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c061e3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788846088.236745:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739074432 00000100:00100000:3.0:1788846088.236749:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739074432 00000100:00100000:3.0:1788846088.236769:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788846088.236775:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0431a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:14407:x1875740739074432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846088.237226:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0431a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:14407:x1875740739074432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 449us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846088.237234:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788846088.237274:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739074432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846088.237307:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739074560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788846088.237346:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846088.237368:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c26173b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846088.237380:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739074560 00000100:00100000:3.0:1788846088.237383:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739074560 00000100:00100000:3.0:1788846088.237404:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788846088.237410:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0431ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:14407:x1875740739074560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788846088.237885:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0431ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:14407:x1875740739074560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 472us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846088.237893:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788846088.240140:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739074560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788846088.243134:0:16584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788846088.244108:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788846088.244144:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788846088.244173:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc4a00/0x1345bc80c774033b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c7740342 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846088.244188:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc4a00/0x1345bc80c774033b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c7740342 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846088.244201:0:14407:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788846088.244205:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c34df6800 from 10 10000000:01000000:3.0:1788846088.244209:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788846088.244260:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c7740349 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846088.244270:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c7740349 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846088.244282:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c7740349 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846088.244314:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739074688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788846088.244403:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846088.244913:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739074688 00000100:00100000:1.0:1788846088.244924:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739074688 00000100:00100000:1.0:1788846088.245066:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788846088.245079:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b04318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+17:14407:x1875740739074688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846088.245099:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846088.245116:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c34bc5c00/0x1345bc80c7740350 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c7740349 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.245150:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c34bc5c00/0x1345bc80c7740350 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c7740349 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.245199:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c34bc5c00/0x1345bc80c7740350 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c7740349 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.245210:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34bc5c00, rc 0) 00000100:00100000:1.0:1788846088.245262:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b04318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:14407:x1875740739074688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846088.245269:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788846088.246096:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c261730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846088.246133:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739074688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846088.246172:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c7740349 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c7740350 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846088.246185:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c7740349 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c7740350 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846088.246271:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c348d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739074816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846088.246321:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846088.246349:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c261730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846088.246373:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739074816 00000100:00100000:3.0:1788846088.246378:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739074816 00000100:00100000:3.0:1788846088.246419:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788846088.246438:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d429c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:14407:x1875740739074816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846088.248360:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d429c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:14407:x1875740739074816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1914us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846088.248376:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788846088.249240:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c348d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739074816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846088.249314:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739074944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788846088.249387:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846088.249438:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c9180 going to sleep for 11 seconds 00000100:00100000:1.0:1788846088.250100:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739074944 00000100:00100000:1.0:1788846088.250110:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739074944 00000100:00100000:1.0:1788846088.250192:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788846088.250202:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:14407:x1875740739074944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788846088.250452:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:14407:x1875740739074944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846088.251233:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788846088.251330:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739074944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788846088.267599:0:16585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788846088.267709:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788846088.267743:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788846088.267758:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c7740349 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c7740350 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.268034:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c01475a00/0x1345bc80c7740349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c7740350 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846088.268048:0:14407:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788846088.268052:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a0c3d38b000 from 10 10000000:01000000:1.0:1788846088.268056:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788846088.268108:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc5a00/0x1345bc80c7740357 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.268117:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc5a00/0x1345bc80c7740357 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.268129:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc5a00/0x1345bc80c7740357 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846088.268188:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739075072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788846088.268283:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846088.268356:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788846088.270286:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739075072 00000100:00100000:3.0:1788846088.270301:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739075072 00000100:00100000:3.0:1788846088.270373:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788846088.270387:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+18:14407:x1875740739075072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846088.270411:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846088.270443:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c01474800/0x1345bc80c774035e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1345bc80c7740357 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846088.271131:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c01474800/0x1345bc80c774035e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1345bc80c7740357 expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846088.271182:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c01474800/0x1345bc80c774035e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1345bc80c7740357 expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846088.271194:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c01474800, rc 0) 00000100:00100000:3.0:1788846088.271287:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:14407:x1875740739075072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 904us (3005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846088.271296:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788846088.272416:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739075072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846088.272464:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc5a00/0x1345bc80c7740357 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774035e expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.272479:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc5a00/0x1345bc80c7740357 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1345bc80c774035e expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846088.272586:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739075200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846088.272646:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846088.272706:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788846088.272903:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739075200 00000100:00100000:3.0:1788846088.272911:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739075200 00000100:00100000:3.0:1788846088.272977:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788846088.272988:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d428050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:14407:x1875740739075200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846088.273321:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d428050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:14407:x1875740739075200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846088.273330:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788846088.273521:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739075200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846088.273563:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739075328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788846088.273608:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846088.273634:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788846088.274920:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739075328 00000100:00100000:3.0:1788846088.274934:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739075328 00000100:00100000:3.0:1788846088.274999:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788846088.275011:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d429050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:14407:x1875740739075328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788846088.275275:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d429050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:14407:x1875740739075328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846088.275282:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788846088.275928:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3ac7e2af-29a9-4384-8c8c-a41d76049816:14407:1875740739075328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788846088.279677:0:16588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788846088.283600:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788846088.283657:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788846088.283673:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc5a00/0x1345bc80c7740357 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774035e expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846088.283690:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9a0c34bc5a00/0x1345bc80c7740357 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1345bc80c774035e expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846088.482880:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846088.484268:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720215296 00000100:00100000:1.0:1788846088.484289:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720215296 00000100:00100000:1.0:1788846088.484373:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:1.0:1788846088.484398:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+11:13756:x1875740720215296:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846088.484430:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846088.484467:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c34bc4800/0x1345bc80c7740365 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d180 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.484508:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c34bc4800/0x1345bc80c7740365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d180 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.484522:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c34bc4800/0x1345bc80c7740365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d180 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.484533:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34bc4800, rc 0) 00000100:00100000:1.0:1788846088.484625:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+12:13756:x1875740720215296:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 241us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846088.484633:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:3.0:1788846088.488627:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846088.488781:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720215424 00000100:00100000:0.0:1788846088.488795:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720215424 00000100:00100000:0.0:1788846088.488871:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:0.0:1788846088.488883:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+12:13756:x1875740720215424:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788846088.489331:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+12:13756:x1875740720215424:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 448us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846088.489342:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:2.0:1788846088.494689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846088.495083:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720215552 00000100:00100000:3.0:1788846088.495097:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720215552 00000100:00100000:3.0:1788846088.495219:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:3.0:1788846088.495232:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d428850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+12:13756:x1875740720215552:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788846088.495603:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d428850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+12:13756:x1875740720215552:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 372us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846088.495612:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:3.0:1788846088.506847:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846088.508593:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720215680 00000100:00100000:1.0:1788846088.508613:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720215680 00000100:00100000:1.0:1788846088.508727:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:1.0:1788846088.508739:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+12:13756:x1875740720215680:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846088.508761:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846088.508781:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0c34bc5200/0x1345bc80c774036c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d187 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.508817:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0c34bc5200/0x1345bc80c774036c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d187 expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.508829:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0c34bc5200/0x1345bc80c774036c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d187 expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846088.508840:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34bc5200, rc 0) 00000100:00100000:1.0:1788846088.508919:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13756:x1875740720215680:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 183us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846088.508926:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:1.0:1788846088.519225:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846088.519330:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720215808 00000100:00100000:0.0:1788846088.519342:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720215808 00000100:00100000:0.0:1788846088.519431:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:0.0:1788846088.519444:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13756:x1875740720215808:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788846088.519829:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13756:x1875740720215808:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 387us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846088.519850:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:1.0:1788846088.533027:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846088.533181:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720215936 00000100:00100000:0.0:1788846088.533195:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720215936 00000100:00100000:0.0:1788846088.533274:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:0.0:1788846088.533288:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d428c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13756:x1875740720215936:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788846088.533897:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d428c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:13756:x1875740720215936:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 609us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846088.533907:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:0.0:1788846088.614431:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739075584:0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.614524:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846088.614600:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788846088.614607:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739075456:0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.614631:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846088.614660:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739075968:0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.614689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846088.614728:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739075712:0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.614752:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846088.614772:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788846088.614777:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739075840:0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.614799:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846088.614836:0:15891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739075584 00000100:00100000:0.0:1788846088.614845:0:15891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739075584 00000100:00100000:0.0:1788846088.614915:0:15891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739075456 00000100:00100000:0.0:1788846088.614919:0:15891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739075456 00000100:00100000:0.0:1788846088.614944:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788846088.614971:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739075584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.615032:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739075584:12345-0@lo:400:kworker.0 Request processed in 64us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846088.615041:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788846088.615062:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788846088.615069:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739075456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.615098:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739075456:12345-0@lo:400:kworker.0 Request processed in 30us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846088.615105:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788846088.615130:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739075968 00000100:00100000:0.0:1788846088.615138:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739075968 00000100:00100000:0.0:1788846088.615207:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739075712 00000100:00100000:0.0:1788846088.615210:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739075712 00000100:00100000:0.0:1788846088.615224:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739075840 00000100:00100000:0.0:1788846088.615226:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739075840 00000100:00100000:0.0:1788846088.615241:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788846088.615247:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739075968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.615280:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875740739075968:12345-0@lo:400:kworker.0 Request processed in 32us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846088.615286:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788846088.615299:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788846088.615305:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739075712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.615336:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739075712:12345-0@lo:400:kworker.0 Request processed in 32us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846088.615342:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788846088.615353:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788846088.615358:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739075840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.615395:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875740739075840:12345-0@lo:400:kworker.0 Request processed in 37us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846088.615401:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788846088.615431:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788846088.615436:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788846088.615439:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788846088.615518:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875740739075840:0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.615531:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739075712:0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.615568:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739076096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788846088.615598:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846088.615625:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739075456:0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.615635:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875740739075968:0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.615646:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739075584:0@lo:400:kworker.0 00000100:00100000:0.0:1788846088.615672:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739076096 00000100:00100000:0.0:1788846088.615675:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739076096 00000100:00100000:0.0:1788846088.615699:0:15098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788846088.615706:0:15098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739076096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788846088.615741:0:15098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788846088.615781:0:15098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739076096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846088.615787:0:15098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788846088.615814:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739076096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788846088.618053:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739076224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788846088.618131:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846088.618389:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739076224 00000100:00100000:2.0:1788846088.618404:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739076224 00000100:00100000:2.0:1788846088.618508:0:15098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788846088.618518:0:15098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739076224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788846088.618560:0:15098:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788846088.618614:0:15098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739076224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846088.618622:0:15098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788846088.618783:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739076224:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788846088.679138:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846089.702510:0:16525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846090.457582:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.457696:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720216064 00000100:00100000:0.0:1788846090.457712:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720216064 00000100:00100000:0.0:1788846090.457826:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:0.0:1788846090.457842:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+6:14413:x1875740720216064:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846090.457869:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846090.457908:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c7740373 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d18e expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.457994:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c774037a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.458220:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c774037a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.458239:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c774037a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788846090.458258:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788846090.458260:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c7740381 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.458269:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c7740381 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.458277:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c7740381 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.458813:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4e00/0x1345bc80c7740388 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.458825:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4e00/0x1345bc80c7740388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.458845:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4e00/0x1345bc80c7740388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846090.459719:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788846090.459727:0:14411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788846090.459795:0:14411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4e00/0x1345bc80c7740388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.459813:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c774037a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.459820:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c774037a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.459828:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c774037a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.459835:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c5400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788846090.459840:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c774037a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.459849:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c774037a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.459865:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f800) 00010000:00010000:0.0:1788846090.459868:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846090.459874:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c774037a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.459952:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c774037a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.459985:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c7740381 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.459992:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c7740381 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.460092:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c7740381 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.460098:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c5800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788846090.460102:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c7740381 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.460109:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c7740381 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.460118:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a0c0619cb00) 00010000:00010000:0.0:1788846090.460120:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846090.460123:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c7740381 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.460130:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c7740381 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.460297:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c7740373 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d18e expref: 8 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.460314:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4e00/0x1345bc80c7740388 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d18e expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.460333:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a0c0619cc00) 00010000:00010000:0.0:1788846090.460336:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788846090.460339:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3e0c4e00, rc 0) 00000100:00100000:0.0:1788846090.460434:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+7:14413:x1875740720216064:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 2597us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846090.460444:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:1.0:1788846090.466745:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846090.466920:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720216320 00000100:00100000:2.0:1788846090.466931:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720216320 00000100:00100000:2.0:1788846090.467000:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1788846090.467010:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+7:14413:x1875740720216320:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846090.467030:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846090.467049:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374c00/0x1345bc80c774038f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d195 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.467389:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c7740396 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.467404:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c7740396 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.467426:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c7740396 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.467451:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c774039d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.467459:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c774039d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.467466:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c774039d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.467770:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375a00/0x1345bc80c77403a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.467779:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375a00/0x1345bc80c77403a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.467798:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375a00/0x1345bc80c77403a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846090.467808:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788846090.468004:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c7740396 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.468012:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c7740396 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.468019:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c7740396 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.468024:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0b04374a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788846090.468029:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c7740396 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.468035:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c7740396 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.468047:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a0c0619cc00) 00010000:00010000:2.0:1788846090.468050:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846090.468055:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c7740396 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.468061:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c7740396 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.468073:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c774039d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.468079:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c774039d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.468092:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c774039d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.468097:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0b04375c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788846090.468100:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c774039d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.468107:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c774039d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.468689:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a0c04c4ff00) 00010000:00010000:2.0:1788846090.468692:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846090.468696:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c774039d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.468703:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c774039d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.469604:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374c00/0x1345bc80c774038f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d195 expref: 10 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.469624:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375a00/0x1345bc80c77403a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d195 expref: 9 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.469632:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f900) 00010000:00010000:2.0:1788846090.469635:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846090.469637:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04375a00, rc 0) 00000100:00100000:2.0:1788846090.469709:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+9:14413:x1875740720216320:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 2699us (2972us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788846090.469725:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:1.0:1788846090.485948:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.488364:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720216448 00000100:00100000:0.0:1788846090.488376:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720216448 00000100:00100000:0.0:1788846090.488455:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:0.0:1788846090.488465:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+9:14413:x1875740720216448:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788846090.488560:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+9:14413:x1875740720216448:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 96us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846090.488568:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:3.0:1788846090.528926:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.529076:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720216576 00000100:00100000:0.0:1788846090.529085:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720216576 00000100:00100000:0.0:1788846090.529184:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:0.0:1788846090.529196:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+9:14419:x1875740720216576:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788846090.529216:0:15118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846090.529235:0:15118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d19c expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529295:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529309:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529331:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529359:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529366:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529373:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529597:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529605:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529611:0:15118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529616:0:15118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c5800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788846090.529620:0:15118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529626:0:15118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529638:0:15118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f800) 00010000:00010000:0.0:1788846090.529641:0:15118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846090.529646:0:15118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529657:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529670:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529675:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529679:0:15118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529684:0:15118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c5400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788846090.529686:0:15118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529691:0:15118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529698:0:15118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a0c0619cb00) 00010000:00010000:0.0:1788846090.529701:0:15118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846090.529703:0:15118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529708:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529737:0:15118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d19c expref: 10 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529758:0:15118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f800) 00010000:00010000:0.0:1788846090.529760:0:15118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846090.529764:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d19c expref: 10 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.529773:0:15118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3e0c4800, rc 0) 00000100:00100000:0.0:1788846090.529828:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+9:14419:x1875740720216576:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 634us (910us total) trans 0 rc 301/301 00000100:00100000:0.0:1788846090.529835:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1788846090.535732:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846090.535829:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720216704 00000100:00100000:3.0:1788846090.535838:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720216704 00000100:00100000:3.0:1788846090.535881:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:3.0:1788846090.535890:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3dddf1bf-7100-425c-add4-3eaf629f103f+9:14419:x1875740720216704:12345-192.168.206.48@tcp:700:lfs.0 00000100:00100000:3.0:1788846090.535976:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3dddf1bf-7100-425c-add4-3eaf629f103f+9:14419:x1875740720216704:12345-192.168.206.48@tcp:700:lfs.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846090.535984:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1788846090.539054:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.539257:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720216960 00000100:00100000:0.0:1788846090.539267:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720216960 00000100:00100000:0.0:1788846090.539324:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:0.0:1788846090.539334:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+9:14419:x1875740720216960:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:0.0:1788846090.539395:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846090.539431:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374600/0x1345bc80c77402f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d117 expref: 9 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.539456:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f800) 00010000:00010000:0.0:1788846090.539461:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846090.539670:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.539684:0:14410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c774032d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d179 expref: 5 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.539693:0:14410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.539732:0:14410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c774032d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d179 expref: 5 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.539746:0:14410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c774032d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d179 expref: 5 pid: 15118 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846090.539760:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14410:1875740739076352:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788846090.539836:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c074aa540 going to sleep for 11 seconds 00000100:00100000:1.0:1788846090.542913:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.543015:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14410:1875740739076352:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788846090.543043:0:14410:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846090.543100:0:16526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720217088 00000100:00100000:3.0:1788846090.543107:0:16526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720217088 00010000:00010000:3.0:1788846090.543197:0:16526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c774032d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d179 expref: 6 pid: 15118 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846090.543225:0:16526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1788846090.543233:0:16526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:2354:x1875740720217088:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846090.543246:0:16526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846090.543252:0:16526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c774032d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d179 expref: 6 pid: 15118 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846090.543264:0:16526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c774032d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d179 expref: 6 pid: 15118 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846090.543300:0:16526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c774032d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d179 expref: 6 pid: 15118 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846090.543316:0:16526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f800) 00010000:00010000:3.0:1788846090.543321:0:16526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846090.543330:0:16526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788846090.543493:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788846090.543555:0:16526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.543643:0:16526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846090.543697:0:16526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+5:2354:x1875740720217088:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 464us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846090.543705:0:16526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00010000:00010000:0.0:1788846090.543760:0:14410:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.543768:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.543791:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.543800:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.543809:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846090.545521:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788846090.545542:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.545552:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.545560:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.545566:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c4800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788846090.545571:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.545578:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.545591:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c04c4f800) 00010000:00010000:0.0:1788846090.545594:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846090.545598:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.545604:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846090.545621:0:14410:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c29ff0c7 reply state 00000000d344a189 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846090.545628:0:14410:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788846090.545703:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+10:14419:x1875740720216960:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 6367us (6654us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788846090.545712:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00010000:00010000:2.0:1788846090.549695:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.549712:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403ce lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.549721:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.549728:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c5400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788846090.549732:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.549740:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403ce lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.549757:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a0c0619cb00) 00010000:00010000:2.0:1788846090.549760:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846090.549764:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403ce lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.549770:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5400/0x1345bc80c77403ce lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846090.622923:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.623019:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720217216 00000100:00100000:0.0:1788846090.623041:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720217216 00000100:00100000:0.0:1788846090.623099:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:0.0:1788846090.623123:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+9:14427:x1875740720217216:12345-192.168.206.48@tcp:101:lctl.0 00010000:00010000:0.0:1788846090.623147:0:15118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846090.623192:0:15118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1a3 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.623254:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.623268:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.623278:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846090.623310:0:15118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788846090.623313:0:15118:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788846090.623361:0:15118:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.623385:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c77403d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1a3 expref: 11 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.623402:0:15118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5800/0x1345bc80c77403dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1a3 expref: 10 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.623420:0:15118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c0619cf00) 00010000:00010000:0.0:1788846090.623423:0:15118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788846090.623426:0:15118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3e0c5800, rc 0) 00000100:00100000:0.0:1788846090.623699:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+10:14427:x1875740720217216:12345-192.168.206.48@tcp:101:lctl.0 Request processed in 589us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846090.623707:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:1.0:1788846090.649546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846090.649641:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720217344 00000100:00100000:2.0:1788846090.649663:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720217344 00000100:00100000:2.0:1788846090.649726:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:2.0:1788846090.649736:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+5:14428:x1875740720217344:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788846090.649757:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846090.649777:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374c00/0x1345bc80c77403e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1aa expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.649838:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c77403ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.649853:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c77403ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.649863:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c77403ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846090.649898:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788846090.649901:0:14411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788846090.649923:0:14411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c77403ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.649944:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374c00/0x1345bc80c77403e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1aa expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.649973:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375c00/0x1345bc80c77403ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1aa expref: 6 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.649983:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c0619cf00) 00010000:00010000:2.0:1788846090.649986:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846090.649990:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04375c00, rc 0) 00000100:00100000:2.0:1788846090.650068:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:14428:x1875740720217344:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 334us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846090.650075:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:3.0:1788846090.652649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846090.652991:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720217472 00000100:00100000:2.0:1788846090.653000:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720217472 00000100:00100000:2.0:1788846090.653071:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:2.0:1788846090.653081:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+6:14428:x1875740720217472:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788846090.653100:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846090.653129:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c77403f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1b1 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653208:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374200/0x1345bc80c77403f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653222:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374200/0x1345bc80c77403f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653233:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374200/0x1345bc80c77403f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653247:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c77403ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653254:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c77403ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653261:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c77403ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653359:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c7740406 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653380:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c7740406 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653387:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c7740406 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846090.653426:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788846090.653430:0:14412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788846090.653454:0:14412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c7740406 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653466:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374200/0x1345bc80c77403f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653472:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374200/0x1345bc80c77403f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653479:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374200/0x1345bc80c77403f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653485:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0b04374200 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788846090.653489:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374200/0x1345bc80c77403f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653500:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374200/0x1345bc80c77403f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653513:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c0619cf00) 00010000:00010000:2.0:1788846090.653516:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846090.653521:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374200/0x1345bc80c77403f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653537:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374200/0x1345bc80c77403f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653555:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c77403ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653562:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c77403ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653567:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c77403ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653571:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0b04375400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788846090.653575:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c77403ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653581:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c77403ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653589:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a0c04c4ff00) 00010000:00010000:2.0:1788846090.653592:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846090.653594:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c77403ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653599:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c77403ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653627:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c77403f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1b1 expref: 8 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653652:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c7740406 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1b1 expref: 7 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.653660:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a0c04c4f700) 00010000:00010000:2.0:1788846090.653662:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846090.653665:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04374800, rc 0) 00000100:00100000:2.0:1788846090.653724:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+7:14428:x1875740720217472:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 644us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846090.653731:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:1.0:1788846090.661796:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846090.661928:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720217728 00000100:00100000:2.0:1788846090.661938:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720217728 00000100:00100000:2.0:1788846090.662184:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:2.0:1788846090.662195:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+7:14428:x1875740720217728:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788846090.662214:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846090.662234:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c774040d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1b8 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846090.662314:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788846090.662454:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c774040d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1b8 expref: 9 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.662469:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c0619cf00) 00010000:00010000:2.0:1788846090.662472:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846090.662477:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c774040d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1b8 expref: 9 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.662508:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04374a00, rc 0) 00000100:00100000:2.0:1788846090.662571:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+8:14428:x1875740720217728:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 378us (783us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788846090.662579:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:1.0:1788846090.664637:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.665328:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720217984 00000100:00100000:0.0:1788846090.665338:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720217984 00000100:00100000:0.0:1788846090.665424:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:0.0:1788846090.665434:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+8:14428:x1875740720217984:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:0.0:1788846090.665493:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846090.665519:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c7740406 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1b1 expref: 8 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.665537:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a0c04c4f700) 00010000:00010000:0.0:1788846090.665547:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846090.665568:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c774041b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.665581:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c774041b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.665589:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c774041b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846090.665775:0:14410:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000520aa246 reply state 00000000d81302bb transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c774041b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846090.665784:0:14410:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788846090.665790:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788846090.665858:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d675500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+9:14428:x1875740720217984:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 425us (1229us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788846090.665865:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00010000:00010000:2.0:1788846090.667642:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c774041b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.667656:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c774041b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.667664:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c774041b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.667670:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c4800 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788846090.667675:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c774041b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.667683:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c774041b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.667697:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a0c0619c700) 00010000:00010000:2.0:1788846090.667700:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788846090.667704:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c774041b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.667710:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4800/0x1345bc80c774041b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846090.669025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.669121:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720218240 00000100:00100000:0.0:1788846090.669130:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720218240 00000100:00100000:0.0:1788846090.669211:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:0.0:1788846090.669221:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+8:14428:x1875740720218240:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788846090.669450:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+9:14428:x1875740720218240:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 220us (422us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788846090.669459:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1788846090.672707:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.672783:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720218496 00000100:00100000:0.0:1788846090.672793:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720218496 00000100:00100000:0.0:1788846090.672846:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:0.0:1788846090.672855:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+9:14428:x1875740720218496:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788846090.672877:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846090.672896:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740422 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1bf expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673003:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740429 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673017:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740429 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673027:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740429 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673045:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c7740430 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673053:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c7740430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673075:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c7740430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846090.673472:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788846090.673558:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740429 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673566:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740429 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673574:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740429 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673580:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c4400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788846090.673584:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740429 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673591:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740429 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673604:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c0619cf00) 00010000:00010000:0.0:1788846090.673607:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846090.673611:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740429 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673617:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740429 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673629:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c7740430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673646:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c7740430 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673652:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c7740430 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673657:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c4000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788846090.673660:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c7740430 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673665:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c7740430 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673674:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a0c0619c300) 00010000:00010000:0.0:1788846090.673676:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846090.673679:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c7740430 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673685:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c7740430 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673728:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740422 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1bf expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673737:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c0619cf00) 00010000:00010000:0.0:1788846090.673739:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788846090.673742:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740422 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1bf expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.673761:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3e0c4600, rc 0) 00000100:00100000:0.0:1788846090.673920:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+10:14428:x1875740720218496:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1065us (1220us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788846090.673928:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:1.0:1788846090.677554:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846090.677628:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720218624 00000100:00100000:2.0:1788846090.677649:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720218624 00000100:00100000:2.0:1788846090.677708:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:2.0:1788846090.677718:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+10:14428:x1875740720218624:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1788846090.677741:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846090.677764:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c774043e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1c6 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.677843:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c7740445 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.677855:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c7740445 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.677866:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c7740445 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846090.677888:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788846090.677892:0:14411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788846090.677908:0:14411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c7740445 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.677933:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374a00/0x1345bc80c774043e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1c6 expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.677949:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c7740445 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1c6 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.677968:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a0c04c4ff00) 00010000:00010000:2.0:1788846090.677970:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846090.677974:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04375400, rc 0) 00000100:00100000:2.0:1788846090.678046:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+11:14428:x1875740720218624:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 329us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846090.678053:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:3.0:1788846090.681759:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.681842:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720218752 00000100:00100000:0.0:1788846090.681872:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720218752 00000100:00100000:0.0:1788846090.681921:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:0.0:1788846090.681931:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+11:14428:x1875740720218752:12345-192.168.206.48@tcp:37:lfs.0 00000100:00100000:0.0:1788846090.686900:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+11:14428:x1875740720218752:12345-192.168.206.48@tcp:37:lfs.0 Request processed in 4960us (5139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846090.686912:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1788846090.689917:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846090.690014:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720219008 00000100:00100000:2.0:1788846090.690024:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720219008 00000100:00100000:2.0:1788846090.690077:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:2.0:1788846090.690086:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c17d05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+11:14428:x1875740720219008:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788846090.690331:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c17d05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+12:14428:x1875740720219008:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 246us (423us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788846090.690339:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00010000:00010000:1.0:1788846090.726320:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846090.737981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846090.738542:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720219136 00000100:00100000:1.0:1788846090.738551:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720219136 00000100:00100000:1.0:1788846090.738653:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:1.0:1788846090.738663:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+10:14434:x1875740720219136:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1788846090.738682:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846090.738704:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5600/0x1345bc80c774044c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1cd expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.738763:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c7740453 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.738776:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c7740453 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.738797:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c7740453 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.738811:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c774045a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.738817:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c774045a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.738823:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c774045a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.738897:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4600/0x1345bc80c7740461 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.738920:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4600/0x1345bc80c7740461 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.738926:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4600/0x1345bc80c7740461 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846090.738962:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788846090.738965:0:14412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788846090.738998:0:14412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4600/0x1345bc80c7740461 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739009:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c7740453 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739015:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c7740453 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739022:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c7740453 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739027:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc4000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788846090.739031:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c7740453 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739037:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c7740453 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739048:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c0619cf00) 00010000:00010000:1.0:1788846090.739051:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846090.739055:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c7740453 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739070:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c7740453 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739083:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c774045a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739089:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c774045a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739094:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c774045a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739099:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc4400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788846090.739101:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c774045a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739107:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c774045a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739130:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a0c07d4f800) 00010000:00010000:1.0:1788846090.739133:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846090.739136:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c774045a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739141:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c774045a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739205:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5600/0x1345bc80c774044c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1cd expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739229:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4600/0x1345bc80c7740461 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1cd expref: 11 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.739236:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a0c04c4ff00) 00010000:00010000:1.0:1788846090.739238:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788846090.739241:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34bc4600, rc 0) 00000100:00100000:1.0:1788846090.739302:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+11:14434:x1875740720219136:12345-192.168.206.48@tcp:101:bash.0 Request processed in 640us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846090.739309:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:3.0:1788846090.743086:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.743909:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720219392 00000100:00100000:0.0:1788846090.743922:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720219392 00000100:00100000:0.0:1788846090.743994:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:0.0:1788846090.744005:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+11:14434:x1875740720219392:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788846090.744025:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846090.744045:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740468 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1d4 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.744168:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.744183:0:14410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c7740445 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1c6 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.744208:0:14410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.744244:0:14410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c7740445 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1c6 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.744258:0:14410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c7740445 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1c6 expref: 11 pid: 14411 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846090.744273:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d52aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14410:1875740739076480:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788846090.744491:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c078c9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788846090.747267:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.747287:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d52aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14410:1875740739076480:192.168.206.48@tcp:104: 00010000:00010000:0.0:1788846090.747315:0:14410:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846090.747359:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720219520 00000100:00100000:1.0:1788846090.747366:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720219520 00010000:00010000:1.0:1788846090.747421:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c7740445 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1c6 expref: 12 pid: 14411 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846090.747463:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1788846090.747473:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+12:2353:x1875740720219520:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846090.747488:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846090.747494:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c7740445 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1c6 expref: 12 pid: 14411 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.747507:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c7740445 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1c6 expref: 12 pid: 14411 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.747531:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375400/0x1345bc80c7740445 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1c6 expref: 12 pid: 14411 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.747565:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a0c04c4ff00) 00010000:00010000:1.0:1788846090.747570:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.747578:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.747585:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.747610:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846090.747658:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+11:2353:x1875740720219520:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 187us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846090.747666:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00010000:00010000:0.0:1788846090.748220:0:14410:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.748230:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.748252:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740476 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.748262:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740476 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.748270:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740476 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.751789:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5000/0x1345bc80c774047d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.751809:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5000/0x1345bc80c774047d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.751821:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5000/0x1345bc80c774047d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846090.751833:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788846090.751861:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.751868:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.751875:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.751881:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c4000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788846090.751886:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.751894:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.751907:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a0c04c4ff00) 00010000:00010000:0.0:1788846090.751910:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846090.751914:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.751936:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4000/0x1345bc80c774046f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846090.751950:0:14410:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c224be9f reply state 000000003233c9d5 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740476 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846090.751960:0:14410:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788846090.751995:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740468 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1d4 expref: 14 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.752010:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5000/0x1345bc80c774047d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1d4 expref: 13 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.752018:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:0.0:1788846090.752020:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788846090.752023:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3e0c5000, rc 0) 00000100:00100000:0.0:1788846090.753183:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+14:14434:x1875740720219392:12345-192.168.206.48@tcp:101:bash.0 Request processed in 9171us (10095us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788846090.753193:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00010000:00010000:0.0:1788846090.754912:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740476 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.754927:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740476 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.754933:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740476 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.754939:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c4400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788846090.754968:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740476 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.754976:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740476 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.754992:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a0c0619c300) 00010000:00010000:0.0:1788846090.754995:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846090.755000:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740476 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.755006:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740476 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846090.793697:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.793820:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720219648 00000100:00100000:0.0:1788846090.793835:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720219648 00000100:00100000:0.0:1788846090.793898:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:0.0:1788846090.793908:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+13:14434:x1875740720219648:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1788846090.793932:0:15118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846090.793951:0:15118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c774048b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1db expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.794017:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740492 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.794030:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.794043:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846090.794092:0:15118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788846090.794095:0:15118:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788846090.794124:0:15118:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.794134:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740492 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.794188:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c774048b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1db expref: 15 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.794206:0:15118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740492 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1db expref: 14 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.794213:0:15118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:0.0:1788846090.794215:0:15118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846090.794218:0:15118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3e0c4600, rc 0) 00000100:00100000:0.0:1788846090.794273:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+14:14434:x1875740720219648:12345-192.168.206.48@tcp:101:bash.0 Request processed in 366us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846090.794280:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:3.0:1788846090.799006:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846090.799104:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720219904 00000100:00100000:2.0:1788846090.799113:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720219904 00000100:00100000:2.0:1788846090.799194:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:2.0:1788846090.799205:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+14:14434:x1875740720219904:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:2.0:1788846090.799532:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+15:14434:x1875740720219904:12345-192.168.206.48@tcp:35:bash.0 Request processed in 328us (534us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788846090.799540:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:2.0:1788846090.875775:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.875894:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720220160 00000100:00100000:0.0:1788846090.875905:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720220160 00000100:00100000:0.0:1788846090.876055:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:0.0:1788846090.876067:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+15:14444:x1875740720220160:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1788846090.876094:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846090.876129:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740499 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1e2 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846090.876284:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788846090.876424:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740499 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1e2 expref: 17 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.876561:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a0c0619cf00) 00010000:00010000:0.0:1788846090.876566:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788846090.876572:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4400/0x1345bc80c7740499 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1e2 expref: 17 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846090.876587:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3e0c4400, rc 0) 00000100:00100000:0.0:1788846090.876654:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+16:14444:x1875740720220160:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 590us (888us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788846090.876673:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:3.0:1788846090.891592:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846090.891685:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720220416 00000100:00100000:2.0:1788846090.891695:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720220416 00000100:00100000:2.0:1788846090.891757:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1788846090.891767:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+16:14444:x1875740720220416:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1788846090.891984:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+17:14444:x1875740720220416:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 218us (404us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788846090.891992:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:3.0:1788846090.963517:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846090.963581:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720220672 00000100:00100000:1.0:1788846090.963591:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720220672 00000100:00100000:1.0:1788846090.963659:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:1.0:1788846090.963673:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+17:14447:x1875740720220672:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1788846090.963700:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846090.963720:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5600/0x1345bc80c77404a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1e9 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.963812:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c77404ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.963827:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c77404ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.963856:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c77404ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846090.963868:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788846090.963984:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5600/0x1345bc80c77404a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1e9 expref: 20 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.964002:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c77404ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1e9 expref: 19 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.964011:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:1.0:1788846090.964015:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788846090.964018:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34bc4400, rc 0) 00000100:00100000:1.0:1788846090.964077:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+19:14447:x1875740720220672:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 406us (570us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788846090.964084:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:3.0:1788846090.967108:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846090.967227:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720220800 00000100:00100000:1.0:1788846090.967235:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720220800 00000100:00100000:1.0:1788846090.967287:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:1.0:1788846090.967296:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+19:14447:x1875740720220800:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:1.0:1788846090.967363:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c77404bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.967380:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c77404bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.967391:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c77404bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.967448:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c77404bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.967456:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c77404bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.967462:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c77404bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.967468:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc4000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788846090.967473:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c77404bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.967480:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c77404bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.967492:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:1.0:1788846090.967496:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788846090.967500:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c77404bc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846090.967506:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c77404bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846090.967574:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+19:14447:x1875740720220800:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 278us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846090.967582:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:3.0:1788846090.972404:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846090.972463:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846090.972552:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720221184 00000100:00100000:0.0:1788846090.972562:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720221184 00000100:00100000:0.0:1788846090.972617:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:0.0:1788846090.972627:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+19:14447:x1875740720221184:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1788846090.972865:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+20:14447:x1875740720221184:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 238us (399us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788846090.972873:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1788846090.973044:0:16526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720220928 00000100:00100000:2.0:1788846090.973049:0:16526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720220928 00000100:00100000:2.0:1788846090.973095:0:16526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:2.0:1788846090.973103:0:16526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+20:2354:x1875740720220928:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846090.973114:0:16526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846090.973135:0:16526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4400/0x1345bc80c77404ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1e9 expref: 20 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846090.973185:0:16526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:2.0:1788846090.973191:0:16526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846090.973218:0:16526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+19:2354:x1875740720220928:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 116us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846090.973224:0:16526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000040:00080000:2.0:1788846090.983323:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788846091.280003:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846091.280190:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720221440 00000100:00100000:1.0:1788846091.280199:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720221440 00000100:00100000:1.0:1788846091.280266:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:1.0:1788846091.280290:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+19:14478:x1875740720221440:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:1.0:1788846091.280313:0:14412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846091.280333:0:14412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c77404c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1f0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.280450:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404ca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.280464:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.280475:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846091.280487:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788846091.280623:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4000/0x1345bc80c77404c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1f0 expref: 22 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.280641:0:14412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1f0 expref: 21 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.280650:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:1.0:1788846091.280653:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788846091.280656:0:14412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34bc4e00, rc 0) 00000100:00100000:1.0:1788846091.280718:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+21:14478:x1875740720221440:12345-192.168.206.48@tcp:101:cat.0 Request processed in 431us (723us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788846091.280725:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:0.0:1788846091.285853:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846091.285929:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720221568 00000100:00100000:1.0:1788846091.285939:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720221568 00000100:00100000:1.0:1788846091.286025:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:1.0:1788846091.286034:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+21:2354:x1875740720221568:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846091.286049:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846091.286069:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1f0 expref: 21 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.286085:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:1.0:1788846091.286089:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846091.286137:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+20:2354:x1875740720221568:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 104us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846091.286144:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:3.0:1788846091.286718:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846091.287465:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720221824 00000100:00100000:0.0:1788846091.287474:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720221824 00000100:00100000:0.0:1788846091.287562:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:0.0:1788846091.287573:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+20:14478:x1875740720221824:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:0.0:1788846091.287891:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+21:14478:x1875740720221824:12345-192.168.206.48@tcp:35:cat.0 Request processed in 319us (1173us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788846091.287898:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:3.0:1788846091.362544:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846091.362693:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720222080 00000100:00100000:1.0:1788846091.362702:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720222080 00000100:00100000:1.0:1788846091.362760:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:1.0:1788846091.362769:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+21:14484:x1875740720222080:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:1.0:1788846091.362792:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846091.362811:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404d8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1f7 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.362900:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5800/0x1345bc80c77404df lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.362914:0:14410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5000/0x1345bc80c774047d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1d4 expref: 22 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.362922:0:14410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740492 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1db expref: 22 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.362943:0:14410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5800/0x1345bc80c77404df lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.362986:0:14410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740492 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1db expref: 22 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.363000:0:14410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740492 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1db expref: 22 pid: 15118 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846091.363013:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d676300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14410:1875740739076608:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788846091.363635:0:14410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5000/0x1345bc80c774047d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1d4 expref: 22 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.363645:0:14410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5000/0x1345bc80c774047d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1d4 expref: 22 pid: 14410 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846091.363656:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d647800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14410:1875740739076736:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788846091.366184:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846091.366233:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d676300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14410:1875740739076608:192.168.206.48@tcp:104: 00000100:00100000:3.0:1788846091.368227:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846091.368712:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720222208 00000100:00100000:0.0:1788846091.368721:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720222208 00010000:00010000:0.0:1788846091.368758:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740492 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1db expref: 23 pid: 15118 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846091.368791:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1788846091.368801:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d3f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+23:2353:x1875740720222208:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846091.368814:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846091.368820:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740492 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1db expref: 23 pid: 15118 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846091.368833:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740492 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1db expref: 23 pid: 15118 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846091.368854:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c7740492 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1db expref: 23 pid: 15118 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846091.368869:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:0.0:1788846091.368874:0:14396:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5800/0x1345bc80c77404df lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846091.368883:0:14396:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5800/0x1345bc80c77404df lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846091.368900:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846091.368964:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d3f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+22:2353:x1875740720222208:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 163us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846091.368972:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:3.0:1788846091.369174:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846091.369265:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720222336 00000100:00100000:3.0:1788846091.369270:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720222336 00010000:00010000:3.0:1788846091.369287:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5000/0x1345bc80c774047d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1d4 expref: 22 pid: 14410 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846091.369307:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1788846091.369314:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+22:2354:x1875740720222336:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846091.369321:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846091.369325:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5000/0x1345bc80c774047d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1d4 expref: 22 pid: 14410 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846091.369335:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5000/0x1345bc80c774047d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1d4 expref: 22 pid: 14410 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846091.369347:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:3.0:1788846091.369350:0:14397:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5800/0x1345bc80c77404df lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846091.369358:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5800/0x1345bc80c77404df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846091.369364:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5800/0x1345bc80c77404df lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846091.369380:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846091.369415:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+22:2354:x1875740720222336:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 91us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846091.369432:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00010000:00010000:1.0:1788846091.369955:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5000/0x1345bc80c774047d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1d4 expref: 21 pid: 14410 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846091.369971:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d647800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14410:1875740739076736:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788846091.369994:0:14410:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5800/0x1345bc80c77404df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.370009:0:14410:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5800/0x1345bc80c77404df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.370015:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5800/0x1345bc80c77404df lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846091.370033:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788846091.370214:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404d8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1f7 expref: 22 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.370229:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5800/0x1345bc80c77404df lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1f7 expref: 21 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.370237:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:1.0:1788846091.370239:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788846091.370314:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34bc5800, rc 0) 00000100:00100000:1.0:1788846091.370349:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+21:14484:x1875740720222080:12345-192.168.206.48@tcp:101:dd.0 Request processed in 7581us (7813us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788846091.370355:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:3.0:1788846091.373563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846091.373648:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720222592 00000100:00100000:1.0:1788846091.373658:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720222592 00000100:00100000:1.0:1788846091.373717:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:1.0:1788846091.373727:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+21:14484:x1875740720222592:12345-192.168.206.48@tcp:36:dd.0 00010000:00010000:1.0:1788846091.373975:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5400/0x1345bc80c77404ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.373991:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5400/0x1345bc80c77404ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.374014:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5400/0x1345bc80c77404ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788846091.374071:0:14412:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788846091.374099:0:14412:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007dd1c019 reply state 000000002173cd1f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5400/0x1345bc80c77404ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846091.374108:0:14412:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788846091.374261:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+24:14484:x1875740720222592:12345-192.168.206.48@tcp:36:dd.0 Request processed in 532us (703us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788846091.374269:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00000020:00080000:1.0:1788846091.374274:0:14412:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788846091.386850:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5400/0x1345bc80c77404ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846091.386867:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5400/0x1345bc80c77404ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846091.386875:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5400/0x1345bc80c77404ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846091.386881:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc5400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788846091.386885:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5400/0x1345bc80c77404ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846091.386892:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5400/0x1345bc80c77404ed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846091.386926:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:2.0:1788846091.386930:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846091.386935:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5400/0x1345bc80c77404ed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846091.386941:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5400/0x1345bc80c77404ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846091.389670:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846091.390190:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720222720 00000100:00100000:0.0:1788846091.390200:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720222720 00000100:00100000:0.0:1788846091.390268:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:0.0:1788846091.390278:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+23:14484:x1875740720222720:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:0.0:1788846091.390301:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846091.390320:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c77404f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d1fe expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846091.390374:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c77404f4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1fe expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846091.390388:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c77404f4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1fe expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846091.390416:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:0.0:1788846091.390420:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788846091.390422:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3e0c4600, rc 0) 00000100:00100000:0.0:1788846091.390482:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+24:14484:x1875740720222720:12345-192.168.206.48@tcp:101:dd.0 Request processed in 206us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846091.390490:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:0.0:1788846091.407356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846091.410360:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720222976 00000100:00100000:1.0:1788846091.410373:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720222976 00000100:00100000:1.0:1788846091.410505:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1788846091.410515:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+24:14484:x1875740720222976:12345-192.168.206.48@tcp:103:dd.0 00010000:00010000:1.0:1788846091.410530:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846091.410553:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4600/0x1345bc80c77404f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d1fe expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.410572:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:1.0:1788846091.410576:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846091.410640:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+23:14484:x1875740720222976:12345-192.168.206.48@tcp:103:dd.0 Request processed in 127us (3293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846091.410648:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:3.0:1788846091.416823:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846091.416902:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720223104 00000100:00100000:1.0:1788846091.416912:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720223104 00000100:00100000:1.0:1788846091.417041:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:1.0:1788846091.417052:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c348d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+23:14484:x1875740720223104:12345-192.168.206.48@tcp:58:dd.0 00010000:00010000:1.0:1788846091.417224:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404fb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.417302:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846091.417316:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788846091.418547:0:14412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788846091.418896:0:14412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788846091.418967:0:14412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788846091.419189:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c348d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+23:14484:x1875740720223104:12345-192.168.206.48@tcp:58:dd.0 Request processed in 2097us (2331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846091.419204:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:0.0:1788846091.421389:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846091.421460:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720223232 00000100:00100000:2.0:1788846091.421470:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720223232 00000100:00100000:2.0:1788846091.421525:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:2.0:1788846091.421535:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+23:14484:x1875740720223232:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:2.0:1788846091.421570:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846091.421591:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374c00/0x1345bc80c7740502 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d205 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846091.421883:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404fb lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846091.421896:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374c00/0x1345bc80c7740502 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d205 expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846091.421914:0:14411:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846091.421928:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374c00/0x1345bc80c7740502 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d205 expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846091.421941:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:2.0:1788846091.421956:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788846091.421961:0:14411:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374c00/0x1345bc80c7740502 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d205 expref: 24 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846091.421969:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04374c00, rc 0) 00000100:00100000:2.0:1788846091.422024:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+24:14484:x1875740720223232:12345-192.168.206.48@tcp:101:dd.0 Request processed in 491us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846091.422031:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:2.0:1788846091.679500:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846091.679540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846091.679623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846091.679678:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720223360 00000100:00100000:1.0:1788846091.679687:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720223360 00000100:00100000:1.0:1788846091.679738:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:1.0:1788846091.679747:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d428450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:2352:x1875740720223360:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788846091.679819:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d428450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:680da2ee-d974-4c5c-a1a4-be7fb770e480+13:2352:x1875740720223360:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 73us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846091.679827:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:2.0:1788846091.683311:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846091.687304:0:15891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720223616 00000100:00100000:0.0:1788846091.687319:0:15891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720223616 00000100:00100000:0.0:1788846091.687394:0:15891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720223872 00000100:00100000:0.0:1788846091.687397:0:15891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720223872 00000100:00100000:0.0:1788846091.687439:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:0.0:1788846091.687451:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+5:2352:x1875740720223616:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788846091.687535:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+5:2352:x1875740720223616:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 88us (7993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846091.687543:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:0.0:1788846091.687562:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:0.0:1788846091.687569:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+5:2352:x1875740720223872:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1788846091.687593:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+5:2352:x1875740720223872:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (7971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846091.687600:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00080000:1.0:1788846091.687964:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788846091.687968:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788846091.688567:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846091.688603:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846091.688663:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720223744 00000100:00100000:1.0:1788846091.688670:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720223744 00000100:00100000:1.0:1788846091.688713:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:1.0:1788846091.688721:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+11:2352:x1875740720223744:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1788846091.688766:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+11:2352:x1875740720223744:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 46us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846091.688782:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:0.0:1788846091.688943:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720223488 00000100:00100000:0.0:1788846091.688948:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720223488 00000100:00100000:0.0:1788846091.688989:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720224000 00000100:00100000:0.0:1788846091.688993:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720224000 00000100:00100000:0.0:1788846091.689008:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:0.0:1788846091.689015:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+5:2352:x1875740720223488:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788846091.689175:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:2.0:1788846091.689184:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+5:2352:x1875740720224000:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1788846091.689216:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1722eb5e-5eb5-4468-911e-fc617f4d1a7f+5:2352:x1875740720224000:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 34us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846091.689223:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00080000:1.0:1788846091.689292:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788846091.689301:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846091.691661:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+5:2352:x1875740720223488:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 2637us (8349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846091.691674:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00010000:00010000:3.0:1788846091.750620:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788846092.006652:0:14442:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788846092.006660:0:14442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788846092.006697:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788846092.006703:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788846092.006823:0:14442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b075e1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14442:1875740739076864:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788846092.006927:0:14442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c103a4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788846092.016123:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846092.016207:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720224128 00000100:00100000:3.0:1788846092.016216:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720224128 00000100:00100000:3.0:1788846092.016297:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:3.0:1788846092.016309:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3dddf1bf-7100-425c-add4-3eaf629f103f+25:14485:x1875740720224128:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 00000100:00080000:1.0:1788846092.016419:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846092.016595:0:14442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b075e1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14442:1875740739076864:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788846092.016996:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3dddf1bf-7100-425c-add4-3eaf629f103f+24:14485:x1875740720224128:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 Request processed in 688us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846092.017006:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1788846092.019888:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846092.020058:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720224256 00000100:00100000:0.0:1788846092.020291:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720224256 00000100:00100000:0.0:1788846092.020355:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:0.0:1788846092.020366:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+24:14485:x1875740720224256:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788846092.020396:0:14410:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788846092.020609:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+24:14485:x1875740720224256:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 244us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846092.020617:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:2.0:1788846092.027287:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846092.028027:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720224384 00000100:00100000:1.0:1788846092.028039:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720224384 00000100:00100000:1.0:1788846092.028121:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:1.0:1788846092.028132:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+24:14485:x1875740720224384:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788846092.028225:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5000/0x1345bc80c7740509 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028241:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5000/0x1345bc80c7740509 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028254:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5000/0x1345bc80c7740509 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028268:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c7740510 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028275:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c7740510 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028281:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c7740510 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028302:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740517 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028331:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028338:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846092.028376:0:15118:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788846092.028380:0:15118:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788846092.028394:0:15118:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028415:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5000/0x1345bc80c7740509 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028421:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5000/0x1345bc80c7740509 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028428:0:15118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5000/0x1345bc80c7740509 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028434:0:15118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc5000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788846092.028438:0:15118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5000/0x1345bc80c7740509 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028445:0:15118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5000/0x1345bc80c7740509 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028456:0:15118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f900) 00010000:00010000:1.0:1788846092.028459:0:15118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846092.028463:0:15118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5000/0x1345bc80c7740509 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028481:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5000/0x1345bc80c7740509 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028494:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c7740510 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028501:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c7740510 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028507:0:15118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c7740510 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028512:0:15118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc4c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788846092.028515:0:15118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c7740510 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028521:0:15118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c7740510 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028529:0:15118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9a0c07d4f800) 00010000:00010000:1.0:1788846092.028532:0:15118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846092.028534:0:15118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c7740510 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028539:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c7740510 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028552:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028559:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740517 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028571:0:15118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740517 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028575:0:15118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc5e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788846092.028578:0:15118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740517 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028584:0:15118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740517 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028591:0:15118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:1.0:1788846092.028594:0:15118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846092.028597:0:15118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740517 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.028602:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740517 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846092.028682:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+24:14485:x1875740720224384:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 551us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846092.028691:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:1.0:1788846092.033735:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.033821:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720224640 00000100:00100000:2.0:1788846092.033839:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720224640 00000100:00100000:2.0:1788846092.033918:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:2.0:1788846092.033929:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+24:14485:x1875740720224640:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846092.033958:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846092.033982:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375200/0x1345bc80c774051e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d20c expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.034073:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740525 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.034093:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740525 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.034105:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740525 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846092.034115:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788846092.034260:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740525 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.034268:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740525 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.034274:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740525 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.034281:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0b04374000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:2.0:1788846092.034286:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740525 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.034307:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740525 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.034325:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:2.0:1788846092.034328:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788846092.034333:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740525 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.034340:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740525 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.034380:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375200/0x1345bc80c774051e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d20c expref: 26 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.034390:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a0c04c4f900) 00010000:00010000:2.0:1788846092.034392:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846092.034396:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375200/0x1345bc80c774051e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d20c expref: 26 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.034414:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04375200, rc 0) 00000100:00100000:2.0:1788846092.034526:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+25:14485:x1875740720224640:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 599us (799us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788846092.034534:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:3.0:1788846092.037807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846092.038087:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720224768 00000100:00100000:1.0:1788846092.038097:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720224768 00000100:00100000:1.0:1788846092.038191:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:1.0:1788846092.038202:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+25:14485:x1875740720224768:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788846092.038238:0:15118:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788846092.038335:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+25:14485:x1875740720224768:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 135us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846092.038350:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:3.0:1788846092.041900:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.042051:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720225024 00000100:00100000:2.0:1788846092.042061:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720225024 00000100:00100000:2.0:1788846092.042126:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:2.0:1788846092.042197:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+25:14485:x1875740720225024:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846092.042238:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846092.042260:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c7740533 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d213 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788846092.043042:0:14411:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1788846092.043049:0:14411:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788846092.043102:0:14411:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788846092.043415:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375000/0x1345bc80c774053a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.043432:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375000/0x1345bc80c774053a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.043444:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375000/0x1345bc80c774053a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.043509:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c7740533 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d213 expref: 28 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.043529:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375000/0x1345bc80c774053a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d213 expref: 27 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.043539:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a0c04c4f000) 00010000:00010000:2.0:1788846092.043542:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846092.043546:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04375000, rc 0) 00000100:00100000:2.0:1788846092.043624:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+27:14485:x1875740720225024:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 1489us (1731us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788846092.043633:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:0.0:1788846092.047826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846092.047912:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720225280 00000100:00100000:1.0:1788846092.047922:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720225280 00000100:00100000:1.0:1788846092.047984:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:1.0:1788846092.047994:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+27:14485:x1875740720225280:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788846092.048045:0:15118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846092.048069:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375000/0x1345bc80c774053a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d213 expref: 27 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048087:0:15118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a0c04c4f000) 00010000:00010000:1.0:1788846092.048096:0:15118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788846092.048256:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740548 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048271:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740548 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048280:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740548 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048293:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c774054f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6eb0738a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048300:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c774054f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6eb0738a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048306:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c774054f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6eb0738a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048376:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740548 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048384:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740548 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048390:0:15118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740548 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048396:0:15118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc5e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788846092.048413:0:15118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740548 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048421:0:15118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740548 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048430:0:15118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a0c04c4ff00) 00010000:00010000:1.0:1788846092.048432:0:15118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846092.048436:0:15118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740548 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048442:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc5e00/0x1345bc80c7740548 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048462:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c774054f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6eb0738a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048468:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c774054f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6eb0738a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048473:0:15118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c774054f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6eb0738a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048486:0:15118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc4c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788846092.048490:0:15118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c774054f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6eb0738a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048496:0:15118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c774054f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6eb0738a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048504:0:15118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6eb0738a (ffff9a0c07d4f800) 00010000:00010000:1.0:1788846092.048506:0:15118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846092.048509:0:15118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c774054f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6eb0738a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.048514:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4c00/0x1345bc80c774054f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6eb0738a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846092.048590:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+26:14485:x1875740720225280:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 597us (771us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788846092.048597:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:3.0:1788846092.053394:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.053615:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720225408 00000100:00100000:2.0:1788846092.053635:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720225408 00000100:00100000:2.0:1788846092.053681:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:2.0:1788846092.053690:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+26:14485:x1875740720225408:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846092.053709:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846092.053730:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c7740556 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d21a expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.053762:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375200/0x1345bc80c774055d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.053774:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375200/0x1345bc80c774055d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.053784:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375200/0x1345bc80c774055d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.053873:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c7740556 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d21a expref: 28 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.053890:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04375200/0x1345bc80c774055d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d21a expref: 27 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.053898:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a0c04c4f600) 00010000:00010000:2.0:1788846092.053901:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788846092.053905:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04375200, rc 0) 00000100:00100000:2.0:1788846092.053976:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+27:14485:x1875740720225408:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 287us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846092.053983:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:3.0:1788846092.058100:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.058235:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720225664 00000100:00100000:2.0:1788846092.058256:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720225664 00000100:00100000:2.0:1788846092.058361:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:2.0:1788846092.058372:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+27:14485:x1875740720225664:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788846092.058467:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740564 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.058483:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740564 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.058494:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740564 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846092.058783:0:14412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788846092.058793:0:14412:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424275639086ns, next at 425275636408ns, rc = 0 00000004:00010000:2.0:1788846092.058882:0:14412:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000153ac9f5 reply state 00000000e5bd708b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740564 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846092.058892:0:14412:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788846092.059304:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+29:14485:x1875740720225664:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 929us (1209us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788846092.059313:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:1.0:1788846092.061291:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:0.0:1788846092.061557:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740564 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.061569:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740564 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.061575:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740564 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.061581:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0b04374000 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:0.0:1788846092.061586:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740564 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.061594:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740564 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.061610:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a0c04c4f600) 00010000:00010000:0.0:1788846092.061613:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788846092.061617:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740564 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.061623:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374000/0x1345bc80c7740564 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846092.061744:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720225792 00000100:00100000:2.0:1788846092.061753:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720225792 00000100:00100000:2.0:1788846092.061811:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:2.0:1788846092.061821:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+28:14485:x1875740720225792:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846092.062078:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846092.062094:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c774056b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d221 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.062334:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c774056b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d221 expref: 29 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.062349:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c774056b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d221 expref: 29 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.062369:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a0c04c4f600) 00010000:00010000:2.0:1788846092.062371:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788846092.062374:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04374400, rc 0) 00000100:00100000:2.0:1788846092.062528:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+29:14485:x1875740720225792:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 708us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846092.062535:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:3.0:1788846092.065097:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.065193:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720225920 00000100:00100000:2.0:1788846092.065203:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720225920 00000100:00100000:2.0:1788846092.065304:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:2.0:1788846092.065314:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+5:2353:x1875740720225920:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788846092.065654:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+6:2353:x1875740720225920:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 340us (564us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788846092.065662:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:2.0:1788846092.067773:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846092.067848:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720226176 00000100:00100000:3.0:1788846092.067857:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720226176 00000100:00100000:3.0:1788846092.067908:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1788846092.067918:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b075e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+29:14485:x1875740720226176:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788846092.068571:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b075e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+30:14485:x1875740720226176:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 652us (801us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788846092.068579:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:1.0:1788846092.071046:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846092.071243:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720226432 00000100:00100000:0.0:1788846092.071252:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720226432 00000100:00100000:0.0:1788846092.071346:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:0.0:1788846092.071356:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+30:14485:x1875740720226432:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788846092.071684:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+30:14485:x1875740720226432:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 328us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846092.071692:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:3.0:1788846092.073663:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846092.073911:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720226560 00000100:00100000:0.0:1788846092.073919:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720226560 00000100:00100000:0.0:1788846092.073979:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:0.0:1788846092.073990:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+30:14485:x1875740720226560:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846092.074008:0:15118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846092.074028:0:15118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5a00/0x1345bc80c7740572 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d228 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.074094:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5e00/0x1345bc80c7740579 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.074122:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5e00/0x1345bc80c7740579 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.074137:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5e00/0x1345bc80c7740579 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846092.074190:0:15118:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788846092.074209:0:15118:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5e00/0x1345bc80c7740579 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15118 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.074255:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5a00/0x1345bc80c7740572 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d228 expref: 32 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.074272:0:15118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5e00/0x1345bc80c7740579 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d228 expref: 31 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.074281:0:15118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a0c04c4f600) 00010000:00010000:0.0:1788846092.074284:0:15118:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788846092.074288:0:15118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c3e0c5e00, rc 0) 00000100:00100000:0.0:1788846092.074816:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+31:14485:x1875740720226560:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 827us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846092.074824:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:3.0:1788846092.078292:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846092.078481:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720226688 00000100:00100000:1.0:1788846092.078491:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720226688 00000100:00100000:1.0:1788846092.078546:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:1.0:1788846092.078556:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+6:2354:x1875740720226688:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788846092.078573:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846092.078593:0:15096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740580 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d22f expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788846092.078875:0:15096:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fa00b, blocks: 0x1 00010000:00010000:1.0:1788846092.078894:0:15096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1788846092.078898:0:15096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.078907:0:15096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740580 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d22f expref: 7 pid: 15096 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.078929:0:15096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740580 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d22f expref: 7 pid: 15096 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.078942:0:15096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0c34bc5e00, rc 0) 00000100:00100000:1.0:1788846092.079002:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+7:2354:x1875740720226688:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 447us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846092.079009:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:1.0:1788846092.081644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.081720:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720226944 00000100:00100000:2.0:1788846092.081729:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720226944 00000100:00100000:2.0:1788846092.081826:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:2.0:1788846092.081836:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+31:14485:x1875740720226944:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788846092.081936:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+31:14485:x1875740720226944:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 101us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846092.081952:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:3.0:1788846092.083975:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846092.084092:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720227072 00000100:00100000:0.0:1788846092.084100:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720227072 00000100:00100000:0.0:1788846092.084144:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:0.0:1788846092.084170:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+31:14485:x1875740720227072:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788846092.129936:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000001:00080000:3.0:1788846092.129980:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1788846092.129991:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:3.0:1788846092.130002:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1788846092.130005:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788846092.130033:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1788846092.130040:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1788846092.130270:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788846092.130291:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739076992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788846092.130374:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846092.130461:0:15891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739076992 00000100:00100000:1.0:1788846092.130468:0:15891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739076992 00000100:00100000:1.0:1788846092.130524:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788846092.130533:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875740739076992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788846092.130677:0:15891:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788846092.130681:0:15891:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788846092.130683:0:15891:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788846092.130685:0:15891:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788846091 -> 1788846091 00002000:00010000:1.0:1788846092.130695:0:15891:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788846092.130738:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1875740739076992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 206us (363us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788846092.130746:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788846092.130770:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788846092.130796:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a0c3d644700/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788846092.130801:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875740739076992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788846092.131012:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+14:14485:x1875740720227072:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 46858us (47042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846092.131020:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:3.0:1788846092.133308:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846092.133778:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720227200 00000100:00100000:1.0:1788846092.133787:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720227200 00000100:00100000:1.0:1788846092.133844:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1788846092.133855:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+7:2353:x1875740720227200:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788846092.134007:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+7:2353:x1875740720227200:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 153us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846092.134016:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1788846092.137751:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846092.137842:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720227456 00000100:00100000:0.0:1788846092.137850:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720227456 00000100:00100000:0.0:1788846092.137906:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:0.0:1788846092.137916:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+14:14485:x1875740720227456:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788846092.137973:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846092.137998:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5e00/0x1345bc80c7740579 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d228 expref: 14 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.138015:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a0c04c4f600) 00010000:00010000:0.0:1788846092.138032:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846092.138062:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5a00/0x1345bc80c7740587 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.138075:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5a00/0x1345bc80c7740587 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.138086:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5a00/0x1345bc80c7740587 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846092.138320:0:14410:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e76bb228 reply state 0000000047cfa10f transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5a00/0x1345bc80c7740587 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846092.138329:0:14410:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788846092.138434:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+15:14485:x1875740720227456:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 519us (692us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788846092.138609:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00010000:00010000:1.0:1788846092.141901:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5a00/0x1345bc80c7740587 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.141918:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5a00/0x1345bc80c7740587 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.141926:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5a00/0x1345bc80c7740587 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.141932:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c5a00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:1.0:1788846092.141936:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5a00/0x1345bc80c7740587 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.141943:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5a00/0x1345bc80c7740587 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.141985:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a0c04c4f600) 00010000:00010000:1.0:1788846092.141988:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846092.141993:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5a00/0x1345bc80c7740587 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.142000:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5a00/0x1345bc80c7740587 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846092.144272:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.144644:0:15891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720227584 00000100:00100000:2.0:1788846092.144653:0:15891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720227584 00000100:00100000:2.0:1788846092.144716:0:15891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:2.0:1788846092.144726:0:15891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+7:14485:x1875740720227584:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846092.144743:0:15891:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846092.144761:0:15891:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d88f4a1/0x1345bc80c774058e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a02f2d8b305d236 expref: -99 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.144802:0:15891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740580 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d22f expref: 8 pid: 15096 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.144810:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846092.144814:0:15891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846092.144819:0:15891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d88f4a1/0x1345bc80c774058e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d236 expref: 8 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.144852:0:15891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740580 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d22f expref: 8 pid: 15096 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.144880:0:15891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740580 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d22f expref: 8 pid: 15096 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846092.144893:0:15891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3eb90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15891:1875740739077120:192.168.206.48@tcp:104: 00000100:00100000:2.0:1788846092.145095:0:15891:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c311c50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846092.150372:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846092.150489:0:15891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3eb90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15891:1875740739077120:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788846092.150522:0:15891:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d88f4a1/0x1345bc80c774058e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d236 expref: 8 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.150544:0:15891:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0b04375000, rc 0) 00000100:00100000:1.0:1788846092.150605:0:15891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+8:14485:x1875740720227584:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 5879us (6342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846092.150614:0:15891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:0.0:1788846092.151834:0:16526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720227712 00000100:00100000:0.0:1788846092.151844:0:16526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720227712 00010000:00010000:1.0:1788846092.152675:0:16526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740580 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d22f expref: 8 pid: 15096 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846092.152765:0:16526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1788846092.152775:0:16526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+8:2354:x1875740720227712:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846092.152790:0:16526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846092.152811:0:16526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740580 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d22f expref: 8 pid: 15096 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.152841:0:16526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740580 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d22f expref: 8 pid: 15096 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.152865:0:16526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740580 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d22f expref: 8 pid: 15096 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.152881:0:16526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.152885:0:16526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.152892:0:16526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d88f4a1/0x1345bc80c774058e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d236 expref: 7 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.152903:0:16526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d88f4a1/0x1345bc80c774058e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d236 expref: 7 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.152939:0:16526:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005d88f4a1/0x1345bc80c774058e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d236 expref: 7 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846092.152966:0:16526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d645880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16526:1875740739077248:192.168.206.48@tcp:105: 00000100:00100000:1.0:1788846092.153145:0:16526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c26173300 going to sleep for 11 seconds 00000100:00100000:3.0:1788846092.156295:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.156381:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720227840 00000100:00100000:2.0:1788846092.156389:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720227840 00000100:00100000:2.0:1788846092.156465:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:2.0:1788846092.156479:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+8:2353:x1875740720227840:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788846092.156670:0:15093:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788846092.156674:0:15093:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788846091 00002000:00010000:2.0:1788846092.156676:0:15093:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788846090 00002000:00010000:2.0:1788846092.156678:0:15093:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788846091 -> 1788846091 00002000:00010000:2.0:1788846092.156680:0:15093:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788846092.156742:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+9:2353:x1875740720227840:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 264us (454us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788846092.156749:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:1.0:1788846092.157261:0:16526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d645880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16526:1875740739077248:192.168.206.48@tcp:105: 00010000:00010000:1.0:1788846092.157293:0:16526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846092.157326:0:16526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+8:2354:x1875740720227712:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 4553us (6963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846092.157348:0:16526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:3.0:1788846092.160038:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846092.160133:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720227968 00000100:00100000:1.0:1788846092.160142:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720227968 00000100:00100000:1.0:1788846092.160225:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:1.0:1788846092.160235:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+8:2354:x1875740720227968:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788846092.160279:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.160303:0:15094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d88f4a1/0x1345bc80c774058e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d236 expref: 8 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.160310:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.160314:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788846092.160318:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.160350:0:15094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d88f4a1/0x1345bc80c774058e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d236 expref: 8 pid: 15891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.160362:0:15094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d88f4a1/0x1345bc80c774058e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d236 expref: 8 pid: 15891 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846092.160375:0:15094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d645880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15094:1875740739077376:192.168.206.48@tcp:104: 00000100:00100000:1.0:1788846092.160585:0:15094:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c26173300 going to sleep for 11 seconds 00000100:00100000:2.0:1788846092.162795:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1788846092.162859:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720228096 00000100:00100000:3.0:1788846092.162867:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720228096 00010000:00010000:3.0:1788846092.162899:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d88f4a1/0x1345bc80c774058e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d236 expref: 9 pid: 15891 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846092.162939:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1788846092.162954:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+9:2354:x1875740720228096:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846092.162967:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846092.162987:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d88f4a1/0x1345bc80c774058e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d236 expref: 9 pid: 15891 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.163000:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d88f4a1/0x1345bc80c774058e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d236 expref: 9 pid: 15891 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.163023:0:14397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788846092.163027:0:14397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788846092.163033:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.163059:0:14397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.163079:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846092.163134:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+9:2354:x1875740720228096:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 180us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846092.163142:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00010000:00010000:1.0:1788846092.163378:0:15094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d88f4a1/0x1345bc80c774058e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d236 expref: 8 pid: 15891 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846092.163398:0:15094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d645880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15094:1875740739077376:192.168.206.48@tcp:104: 00010000:00010000:1.0:1788846092.163437:0:15094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.163456:0:15094:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.163464:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.163485:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.163493:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.163501:0:15094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.163508:0:15094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc5e00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846092.163512:0:15094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.163520:0:15094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.163537:0:15094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.163545:0:15094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c7740595 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846092.163601:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+7:2354:x1875740720227968:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 3368us (3571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846092.163609:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1788846092.165896:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846092.165982:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720228352 00000100:00100000:0.0:1788846092.165991:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720228352 00000100:00100000:0.0:1788846092.166047:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:0.0:1788846092.166057:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+14:14485:x1875740720228352:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788846092.166144:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5c00/0x1345bc80c774059c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.166194:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5c00/0x1345bc80c774059c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.166205:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5c00/0x1345bc80c774059c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.166458:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.166471:0:14412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c774056b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d221 expref: 15 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.166478:0:14412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.166511:0:14412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c774056b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d221 expref: 15 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.166524:0:14412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c774056b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d221 expref: 15 pid: 14411 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846092.166536:0:14412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d672a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14412:1875740739077504:192.168.206.48@tcp:104: 00000100:00100000:0.0:1788846092.166615:0:14412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c17ccda80 going to sleep for 11 seconds 00000100:00100000:2.0:1788846092.168714:0:14412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d672a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14412:1875740739077504:192.168.206.48@tcp:104: 00010000:00010000:2.0:1788846092.168742:0:14412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846092.169109:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846092.169206:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720228480 00000100:00100000:1.0:1788846092.169213:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720228480 00010000:00010000:1.0:1788846092.169248:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c774056b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d221 expref: 16 pid: 14411 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846092.169283:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:1.0:1788846092.169291:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3eb90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+16:2353:x1875740720228480:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846092.169304:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846092.169311:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c774056b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d221 expref: 16 pid: 14411 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.169323:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c774056b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d221 expref: 16 pid: 14411 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.169344:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374400/0x1345bc80c774056b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d221 expref: 16 pid: 14411 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.169368:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a0c04c4f600) 00010000:00010000:1.0:1788846092.169372:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.169381:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.169387:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.169452:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846092.169502:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+15:2353:x1875740720228480:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 212us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846092.169510:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00010000:00010000:0.0:1788846092.169667:0:14412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.169675:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788846092.169838:0:14412:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788846092.169974:0:14412:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788846092.170021:0:14412:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788846092.170097:0:14412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14412:1875740739077632:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788846092.170144:0:14412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846092.170223:0:14412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b18300 going to sleep for 11 seconds 00000100:00100000:2.0:1788846092.170295:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739077632 00000100:00100000:2.0:1788846092.170301:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739077632 00000100:00100000:2.0:1788846092.170336:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846092.170344:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14412:x1875740739077632:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788846092.170419:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14412:x1875740739077632:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846092.170425:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788846092.170562:0:14412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14412:1875740739077632:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788846092.171136:0:14412:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788846092.171227:0:14412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d671c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14412:1875740739077760:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788846092.171260:0:14412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846092.171276:0:14412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c06b18180 going to sleep for 11 seconds 00000100:00100000:2.0:1788846092.171593:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739077760 00000100:00100000:2.0:1788846092.171600:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739077760 00000100:00100000:2.0:1788846092.171636:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788846092.171643:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14412:x1875740739077760:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788846092.171803:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14412:x1875740739077760:12345-0@lo:1000:mdt00_002.0 Request processed in 159us (541us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788846092.171811:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788846092.171905:0:14412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d671c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14412:1875740739077760:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788846092.171936:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.171945:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.171952:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.171959:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c4c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788846092.171963:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.171971:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.171986:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a0c04c4f600) 00010000:00010000:3.0:1788846092.171989:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788846092.171993:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.172010:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c4c00/0x1345bc80c77405a3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.172041:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404fb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.172047:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404fb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.172052:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.172057:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc4e00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788846092.172061:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404fb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.172067:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404fb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.172075:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:3.0:1788846092.172078:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788846092.172084:0:14412:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374c00/0x1345bc80c7740502 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d205 expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.172094:0:14412:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374c00/0x1345bc80c7740502 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d205 expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.172102:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374c00/0x1345bc80c7740502 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d205 expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.172141:0:14412:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374c00/0x1345bc80c7740502 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x7a02f2d8b305d205 expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846092.172190:0:14412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b07651180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14412:1875740739077888:192.168.206.48@tcp:105: 00000100:00100000:3.0:1788846092.172244:0:14412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a0c200f2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788846092.175858:0:14412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b07651180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14412:1875740739077888:192.168.206.48@tcp:105: 00010000:00010000:3.0:1788846092.175890:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404fb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.175901:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34bc4e00/0x1345bc80c77404fb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.175939:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c77405aa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.175952:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c77405aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.175963:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c77405aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.175974:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c77405aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.175980:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c77405aa lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.175986:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c77405aa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.176007:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34a01400 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788846092.176011:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c77405aa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.176018:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c77405aa lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.176030:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:3.0:1788846092.176033:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846092.176036:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c77405aa lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.176042:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c34a01400/0x1345bc80c77405aa lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.176052:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5c00/0x1345bc80c774059c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.176058:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5c00/0x1345bc80c774059c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.176064:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5c00/0x1345bc80c774059c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.176069:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c5c00 already unused, calling callback (ffffffffc1fc74f0) 00010000:00010000:3.0:1788846092.176072:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5c00/0x1345bc80c774059c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.176078:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5c00/0x1345bc80c774059c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.176097:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a0c0619c400) 00010000:00010000:3.0:1788846092.176099:0:14412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788846092.176102:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5c00/0x1345bc80c774059c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.176108:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0c3e0c5c00/0x1345bc80c774059c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846092.176582:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3eb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dddf1bf-7100-425c-add4-3eaf629f103f+18:14485:x1875740720228352:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 10523us (10691us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788846092.176594:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00000020:00080000:2.0:1788846092.176600:0:14412:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788846092.176741:0:14442:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788846092.176746:0:14442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788846092.177531:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000040:00080000:0.0:1788846092.177670:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788846092.177679:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788846092.177918:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720228608 00000100:00100000:3.0:1788846092.177926:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720228608 00000100:00100000:3.0:1788846092.178008:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:3.0:1788846092.178018:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c17d06c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+18:14484:x1875740720228608:12345-192.168.206.48@tcp:49:dd.0 00000100:00100000:3.0:1788846092.178140:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c17d06c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dddf1bf-7100-425c-add4-3eaf629f103f+18:14484:x1875740720228608:12345-192.168.206.48@tcp:49:dd.0 Request processed in 124us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846092.178148:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:3.0:1788846092.184719:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.185009:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720228864 00000100:00100000:2.0:1788846092.185018:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720228864 00000100:00100000:2.0:1788846092.185070:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:2.0:1788846092.185080:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+18:14485:x1875740720228864:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788846092.185852:0:14413:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788846092.185953:0:14413:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788846092.185994:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c77405b1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.186011:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c77405b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.186022:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c77405b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.186030:0:14413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c77405b1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.186036:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c77405b1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.186042:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c77405b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.186055:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788846092.186149:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+20:14485:x1875740720228864:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 1068us (1436us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788846092.186180:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000020:00080000:2.0:1788846092.186184:0:14413:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788846092.186250:0:15892:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846092.186268:0:15892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c77405b1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.186275:0:15892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0b04374800 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846092.186279:0:15892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c77405b1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.186286:0:15892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c77405b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.186299:0:15892:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a0c04c4f600) 00010000:00010000:0.0:1788846092.186302:0:15892:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788846092.186307:0:15892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c77405b1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.186313:0:15892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0b04374800/0x1345bc80c77405b1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.186323:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846092.186325:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846092.186333:0:15892:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846092.357296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1788846092.357341:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.357573:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720228992 00000100:00100000:2.0:1788846092.357582:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720228992 00000100:00100000:2.0:1788846092.357638:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720229120 00000100:00100000:2.0:1788846092.357641:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720229120 00000100:00100000:2.0:1788846092.357662:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:2.0:1788846092.357672:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+8:2351:x1875740720228992:12345-192.168.206.48@tcp:4:dd.0 00002000:00010000:2.0:1788846092.357723:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9fa00b, atime: 0x6a9fa00a, ctime: 0x6a9fa00b, blocks: 0x1 00010000:00010000:2.0:1788846092.357744:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc774a7f/0x1345bc80c77405b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.357761:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=424s v=(0 0) 00010000:00010000:2.0:1788846092.357766:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846092.357772:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc774a7f/0x1345bc80c77405b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846092.357786:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc774a7f/0x1345bc80c77405b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846092.359826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1788846092.360480:0:15100:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788846092.360490:0:15100:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788846092.361452:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.361673:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788846092.361689:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720229248 00000100:00100000:2.0:1788846092.361698:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720229248 00000100:00100000:2.0:1788846092.361746:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788846092.361751:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720229376 00000100:00100000:2.0:1788846092.361754:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720229376 00000100:00100000:3.0:1788846092.363972:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.364183:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788846092.364193:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720229504 00000100:00100000:2.0:1788846092.364204:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720229504 00000100:00100000:3.0:1788846092.364389:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.364497:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788846092.364506:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720229632 00000100:00100000:2.0:1788846092.364510:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720229632 00000100:00100000:1.0:1788846092.364884:0:16642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:1.0:1788846092.364894:0:16642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+13:2351:x1875740720229120:12345-192.168.206.48@tcp:4:dd.0 00010000:00010000:1.0:1788846092.364932:0:16642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.364949:0:16642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.365026:0:16642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.365033:0:16642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.365186:0:16642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846092.372211:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.372387:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788846092.375450:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1788846092.377808:0:15101:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788846092.378290:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720229760 00000100:00100000:2.0:1788846092.378299:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720229760 00000100:00100000:1.0:1788846092.380535:0:16643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1788846092.380573:0:16643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3dddf1bf-7100-425c-add4-3eaf629f103f+15:2352:x1875740720229248:12345-192.168.206.48@tcp:4:dd.0 00010000:00010000:1.0:1788846092.380612:0:16643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000793a5287/0x1345bc80c77405c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.380631:0:16643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.380635:0:16643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.380641:0:16643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000793a5287/0x1345bc80c77405c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.380653:0:16643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000793a5287/0x1345bc80c77405c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846092.385244:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788846092.386791:0:15100:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788846092.389592:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740720229888 00000100:00100000:0.0:1788846092.389607:0:15100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740720229888 00000100:00100000:2.0:1788846092.390258:0:15101:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1788846092.393415:0:16644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1788846092.393432:0:16644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3dddf1bf-7100-425c-add4-3eaf629f103f+17:2352:x1875740720229376:12345-192.168.206.48@tcp:4:dd.0 00010000:00010000:1.0:1788846092.393473:0:16644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f11dd74/0x1345bc80c77405cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.393492:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.393496:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.393503:0:16644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f11dd74/0x1345bc80c77405cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.393516:0:16644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f11dd74/0x1345bc80c77405cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846092.483678:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1788846092.483692:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:2.0:1788846092.483705:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:1.0:1788846092.484059:0:16642:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1788846092.484305:0:16642:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788846091 -> 1788846092 00002000:00010000:1.0:1788846092.484308:0:16642:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788846091 -> 1788846092 00002000:00010000:1.0:1788846092.484311:0:16642:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1788846092.484326:0:16642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.484338:0:16642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.484347:0:16642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.484356:0:16642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc5600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846092.484360:0:16642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.484369:0:16642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.484388:0:16642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.484396:0:16642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846092.484575:0:16642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+19:2351:x1875740720229120:12345-192.168.206.48@tcp:4:dd.0 Request processed in 119677us (127228us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788846092.484586:0:16642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:1.0:1788846092.484615:0:16642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1788846092.484626:0:16642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+18:2351:x1875740720229504:12345-192.168.206.48@tcp:4:dd.0 00010000:00010000:1.0:1788846092.484658:0:16642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c77405d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.484671:0:16642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.484675:0:16642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.484681:0:16642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c77405d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.484693:0:16642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c77405d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788846092.501616:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:1.0:1788846092.501641:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc774a7f/0x1345bc80c77405b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.501654:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc774a7f/0x1345bc80c77405b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.501662:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc774a7f/0x1345bc80c77405b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.501681:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0b04374800 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846092.501687:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc774a7f/0x1345bc80c77405b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.501696:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc774a7f/0x1345bc80c77405b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.501717:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc774a7f/0x1345bc80c77405b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.501730:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc774a7f/0x1345bc80c77405b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846092.501834:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+18:2351:x1875740720228992:12345-192.168.206.48@tcp:4:dd.0 Request processed in 144158us (144542us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788846092.501843:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1788846092.501875:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1788846092.501886:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+17:2351:x1875740720229632:12345-192.168.206.48@tcp:4:dd.0 00010000:00010000:1.0:1788846092.501925:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.501937:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.501942:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.501948:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.502255:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846092.551683:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1788846092.551948:0:16644:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00010000:00010000:1.0:1788846092.551964:0:16644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f11dd74/0x1345bc80c77405cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.551977:0:16644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f11dd74/0x1345bc80c77405cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.551986:0:16644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f11dd74/0x1345bc80c77405cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.551994:0:16644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc5400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:1.0:1788846092.551999:0:16644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f11dd74/0x1345bc80c77405cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.552008:0:16644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f11dd74/0x1345bc80c77405cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.552028:0:16644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f11dd74/0x1345bc80c77405cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.552036:0:16644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f11dd74/0x1345bc80c77405cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846092.552407:0:16644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3dddf1bf-7100-425c-add4-3eaf629f103f+17:2352:x1875740720229376:12345-192.168.206.48@tcp:4:dd.0 Request processed in 158964us (190943us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788846092.552418:0:16644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1788846092.552613:0:16644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:1.0:1788846092.552629:0:16644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3dddf1bf-7100-425c-add4-3eaf629f103f+16:2352:x1875740720229760:12345-192.168.206.48@tcp:4:dd.0 00010000:00010000:1.0:1788846092.552659:0:16644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004404882a/0x1345bc80c77405e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.552671:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.552676:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846092.552682:0:16644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004404882a/0x1345bc80c77405e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846092.552694:0:16644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004404882a/0x1345bc80c77405e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.552712:0:16643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000793a5287/0x1345bc80c77405c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.552786:0:16643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000793a5287/0x1345bc80c77405c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.552794:0:16643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000793a5287/0x1345bc80c77405c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.552801:0:16643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc4400 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846092.552804:0:16643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000793a5287/0x1345bc80c77405c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.552813:0:16643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000793a5287/0x1345bc80c77405c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.552827:0:16643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000793a5287/0x1345bc80c77405c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.552833:0:16643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000793a5287/0x1345bc80c77405c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846092.552940:0:16643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3dddf1bf-7100-425c-add4-3eaf629f103f+16:2352:x1875740720229248:12345-192.168.206.48@tcp:4:dd.0 Request processed in 172382us (193121us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788846092.553083:0:16643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:0.0:1788846092.553100:0:16643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:0.0:1788846092.553108:0:16643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b07653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3dddf1bf-7100-425c-add4-3eaf629f103f+15:2352:x1875740720229888:12345-192.168.206.48@tcp:4:dd.0 00010000:00010000:0.0:1788846092.553126:0:16643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9a6f1fd/0x1345bc80c77405e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.553134:0:16643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846092.553137:0:16643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846092.553141:0:16643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9a6f1fd/0x1345bc80c77405e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.553150:0:16643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9a6f1fd/0x1345bc80c77405e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788846092.597329:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1788846092.597504:0:15099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:0.0:1788846092.597509:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1788846092.597551:0:16642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c77405d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.597565:0:16642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c77405d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.597592:0:16642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c77405d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.597595:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.597603:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.597620:0:16642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc5e00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846092.597620:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.597625:0:16642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c77405d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.597626:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc5600 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846092.597630:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.597635:0:16642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c77405d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.597636:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.597658:0:16642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c77405d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.597658:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.597668:0:16642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d7a1da/0x1345bc80c77405d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.597668:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000429d0231/0x1345bc80c77405db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846092.597756:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07651880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3dddf1bf-7100-425c-add4-3eaf629f103f+15:2351:x1875740720229632:12345-192.168.206.48@tcp:4:dd.0 Request processed in 95869us (233685us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788846092.597766:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:2.0:1788846092.598882:0:16642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3dddf1bf-7100-425c-add4-3eaf629f103f+13:2351:x1875740720229504:12345-192.168.206.48@tcp:4:dd.0 Request processed in 114256us (234916us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1788846092.598892:0:16642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000001:00080000:2.0:1788846092.639586:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:3.0:1788846092.639684:0:16644:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:3.0:1788846092.639701:0:16644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004404882a/0x1345bc80c77405e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.639714:0:16644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004404882a/0x1345bc80c77405e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.639724:0:16644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004404882a/0x1345bc80c77405e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.639750:0:16644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c34bc4e00 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:3.0:1788846092.639755:0:16644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004404882a/0x1345bc80c77405e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.639764:0:16644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004404882a/0x1345bc80c77405e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.639783:0:16644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004404882a/0x1345bc80c77405e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846092.639791:0:16644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004404882a/0x1345bc80c77405e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846092.639886:0:16644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:3dddf1bf-7100-425c-add4-3eaf629f103f+7:2352:x1875740720229760:12345-192.168.206.48@tcp:4:dd.0 Request processed in 87256us (267679us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788846092.639901:0:16644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00010000:00010000:0.0:1788846092.640259:0:16643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9a6f1fd/0x1345bc80c77405e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.640270:0:16643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9a6f1fd/0x1345bc80c77405e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.640290:0:16643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9a6f1fd/0x1345bc80c77405e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.640296:0:16643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0c3e0c5200 already unused, calling callback (ffffffffc15b8350) 00010000:00010000:0.0:1788846092.640300:0:16643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9a6f1fd/0x1345bc80c77405e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.640307:0:16643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9a6f1fd/0x1345bc80c77405e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.640318:0:16643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9a6f1fd/0x1345bc80c77405e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846092.640325:0:16643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9a6f1fd/0x1345bc80c77405e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846092.640366:0:16643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b07653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3dddf1bf-7100-425c-add4-3eaf629f103f+5:2352:x1875740720229888:12345-192.168.206.48@tcp:4:dd.0 Request processed in 87259us (264933us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788846092.640374:0:16643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00010000:00010000:0.0:1788846092.774393:0:16525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846093.736324:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788846093.736345:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739078016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788846093.736428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846093.736493:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739078016 00000100:00100000:0.0:1788846093.736500:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739078016 00000100:00100000:0.0:1788846093.736562:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788846093.736570:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739078016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788846093.736589:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:0.0:1788846093.736629:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875740739078016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846093.736635:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788846093.736673:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788846093.736678:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a0c3d644700, transno 8589934595 00000004:00080000:0.0:1788846093.736688:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1788846093.736710:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875740739078016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788846093.737022:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846093.737032:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0b07652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739078144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788846093.737062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846093.737230:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d645880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ac7e2af-29a9-4384-8c8c-a41d76049816:3309:1875740739078272:0@lo:400:kworker.0 00000100:00100000:1.0:1788846093.737262:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846093.737285:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788846093.737289:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739078400:0@lo:400:kworker.0 00000100:00100000:1.0:1788846093.737310:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846093.737336:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739078528:0@lo:400:kworker.0 00000100:00100000:1.0:1788846093.737354:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846093.737369:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788846093.738492:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a0c3d645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739078656:0@lo:400:kworker.0 00000100:00100000:1.0:1788846093.738531:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846093.738571:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739078272 00000100:00100000:1.0:1788846093.738577:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739078272 00000100:00100000:1.0:1788846093.738616:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788846093.738624:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d42a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:3309:x1875740739078272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846093.738666:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d42a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3ac7e2af-29a9-4384-8c8c-a41d76049816+19:3309:x1875740739078272:12345-0@lo:400:kworker.0 Request processed in 43us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846093.738673:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788846093.738703:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739078400 00000100:00100000:1.0:1788846093.738708:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739078400 00000100:00100000:1.0:1788846093.738731:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739078528 00000100:00100000:1.0:1788846093.738734:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739078528 00000100:00100000:1.0:1788846093.738754:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739078656 00000100:00100000:1.0:1788846093.738757:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739078656 00000100:00100000:1.0:1788846093.738771:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788846093.738776:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739078400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846093.738809:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875740739078400:12345-0@lo:400:kworker.0 Request processed in 33us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846093.738815:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788846093.738825:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788846093.738830:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739078528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846093.738857:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875740739078528:12345-0@lo:400:kworker.0 Request processed in 26us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846093.738861:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788846093.738871:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788846093.738877:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0c3d645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739078656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846093.739713:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740739078144 00000100:00100000:3.0:1788846093.739721:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740739078144 00000100:00100000:3.0:1788846093.739768:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788846093.739777:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a0b0592ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739078144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788846093.739806:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788846093.739851:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0b0592ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875740739078144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (2786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846093.739858:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788846093.741045:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a0c3d645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875740739078656:12345-0@lo:400:kworker.0 Request processed in 2167us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846093.741053:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788846093.741095:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788846093.741100:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846093.741133:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875740739078400:0@lo:400:kworker.0 00000100:00100000:1.0:1788846093.741146:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d645880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3ac7e2af-29a9-4384-8c8c-a41d76049816:3309:1875740739078272:0@lo:400:kworker.0 00000100:00100000:1.0:1788846093.741198:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875740739078656:0@lo:400:kworker.0 00000100:00100000:1.0:1788846093.741210:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0c3d647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875740739078528:0@lo:400:kworker.0 00000100:00100000:1.0:1788846093.741228:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a0b07652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875740739078144:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788846093.803004:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788846094.174856:0:16684:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788846094.823279:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28631 lines, 28631 kept, 0 dropped, 0 bad.